-Re: expressing job anti-affinity in Yarn.
ricky l 2014-01-09, 17:08
Thanks. I checked the issue and it seems still "unresolved". Can I assume
the feature is not supported yet?
On Thu, Jan 9, 2014 at 12:00 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> YARN-1042 add ability to specify affinity/anti-affinity in container
> On Thu, Jan 9, 2014 at 8:48 AM, ricky l <[EMAIL PROTECTED]> wrote:
>> Hi all,
>> Is it possible to express the job anti-affinity in the Yarn-based hadoop?
>> I have a job that is very IO-intensive, and I want to spread the tasks
>> across all available machines. In a default Yarn RM scheduler, it seems
>> many tasks are scheduled in one machine while others are idle.