Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - yarn.nodemanager.vmem-check-enabled


Copy link to this message
-
Re: yarn.nodemanager.vmem-check-enabled
Sandy Ryza 2013-10-24, 01:19
Hi John,

At Cloudera we turn it off by default and recommend doing so because of the
way that Java can behave weirdly with high vmems.

-Sandy
On Sun, Oct 20, 2013 at 7:34 AM, John Lilley <[EMAIL PROTECTED]>wrote:

>  Is this option typically enabled in practice?  Is there a way for a
> specific AM to disable it, or is it site-wide?****
>
> We are finding that our YARN application, because it launches many
> threads, each with a somewhat large stack, has a large vmem/pmem ratio
> (say, 2GB / 200MB).  Unless we disable this option, the NM tends to kill
> our tasks.****
>
> Thanks****
>
> John****
>
> ** **
>