Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> expressing job anti-affinity in Yarn.

Copy link to this message
Re: expressing job anti-affinity in Yarn.
Thanks. I checked the issue and it seems still "unresolved".  Can I assume
the feature is not supported yet?
On Thu, Jan 9, 2014 at 12:00 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> See:
> YARN-1042 add ability to specify affinity/anti-affinity in container
> requests
> On Thu, Jan 9, 2014 at 8:48 AM, ricky l <[EMAIL PROTECTED]> wrote:
>> Hi all,
>> Is it possible to express the job anti-affinity in the Yarn-based hadoop?
>> I have a job that is very IO-intensive, and I want to spread the tasks
>> across all available machines. In a default Yarn RM scheduler, it seems
>> many tasks are scheduled in one machine while others are idle.
>> thanks.