Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - whitelist feature of YARN

Copy link to this message
Re: whitelist feature of YARN
Sandy Ryza 2013-08-07, 06:07
YARN-521, which brings whitelisting to the AMRMClient APIs, is now included
in 2.1.0-beta.  Check out the doc for the relaxLocality paramater in
ContainerRequest in AMRMClient:
I can help clarify here if anything's confusing.

On Tue, Jul 9, 2013 at 2:54 AM, Krishna Kishore Bonagiri <

> Hi Sandy,
>   Yes, I have been using AMRMClient APIs. I am planning to shift to
> whatever way is this white list feature is supported with. But am not sure
> what is meant by submitting ResourceRequests directly to RM. Can you please
> elaborate on this or give me a pointer to some example code on how to do
> it...
>    Thanks for the reply,
> -Kishore
> On Mon, Jul 8, 2013 at 10:53 PM, Sandy Ryza <[EMAIL PROTECTED]>wrote:
>> Hi Krishna,
>> From your previous email, it looks like you are using the AMRMClient
>> APIs.  Support for whitelisting is not yet supported through them.  I am
>> working on this in YARN-521, which should be included in the next release
>> after 2.1.0-beta.  If you are submitting ResourceRequests directly to the
>> RM, you can whitelist a node by
>> * setting the relaxLocality flag on the node-level ResourceRequest to true
>> * setting the relaxLocality flag on the corresponding rack-level
>> ResourceRequest to false
>> * setting the relaxLocality flag on the corresponding any-level
>> ResourceRequest to false
>> -Sandy
>> On Mon, Jul 8, 2013 at 6:48 AM, Krishna Kishore Bonagiri <
>> [EMAIL PROTECTED]> wrote:
>>> Hi,
>>>   Can someone please point to some example code of how to use the
>>> whitelist feature of YARN, I have recently got RC1 for hadoop-2.1.0-beta
>>> and want to use this feature.
>>>   It would be great if you can point me to some description of what this
>>> white listing feature is, I have gone through some JIRA logs related to
>>> this but more concrete explanation would be helpful.
>>> Thanks,
>>> Kishore