Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> expressing job anti-affinity in Yarn.


Copy link to this message
-
Re: expressing job anti-affinity in Yarn.
Thanks. I checked the issue and it seems still "unresolved".  Can I assume
the feature is not supported yet?
On Thu, Jan 9, 2014 at 12:00 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> See:
> YARN-1042 add ability to specify affinity/anti-affinity in container
> requests
>
>
> On Thu, Jan 9, 2014 at 8:48 AM, ricky l <[EMAIL PROTECTED]> wrote:
>
>> Hi all,
>>
>> Is it possible to express the job anti-affinity in the Yarn-based hadoop?
>> I have a job that is very IO-intensive, and I want to spread the tasks
>> across all available machines. In a default Yarn RM scheduler, it seems
>> many tasks are scheduled in one machine while others are idle.
>>
>> thanks.
>>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB