Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> expressing job anti-affinity in Yarn.


Copy link to this message
-
Re: expressing job anti-affinity in Yarn.
Thanks. I checked the issue and it seems still "unresolved".  Can I assume
the feature is not supported yet?
On Thu, Jan 9, 2014 at 12:00 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> See:
> YARN-1042 add ability to specify affinity/anti-affinity in container
> requests
>
>
> On Thu, Jan 9, 2014 at 8:48 AM, ricky l <[EMAIL PROTECTED]> wrote:
>
>> Hi all,
>>
>> Is it possible to express the job anti-affinity in the Yarn-based hadoop?
>> I have a job that is very IO-intensive, and I want to spread the tasks
>> across all available machines. In a default Yarn RM scheduler, it seems
>> many tasks are scheduled in one machine while others are idle.
>>
>> thanks.
>>
>
>