Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> ResourceManager webapp code runs OOM


+
Prashant Kommireddi 2013-10-21, 22:53
+
Ravi Prakash 2013-10-22, 19:55
+
Prashant Kommireddi 2013-10-22, 21:41
Copy link to this message
-
Re: ResourceManager webapp code runs OOM
Hi Prashant!

You're welcome. I believe for MR JHS it ought to be mapreduce.jobhistory.joblist.cache.size

HTH
Ravi
On Tuesday, October 22, 2013 7:29 PM, Prashant Kommireddi <[EMAIL PROTECTED]> wrote:
 
Hi Ravi,

Are you aware of a similar config for JH server?

On Tue, Oct 22, 2013 at 2:41 PM, Prashant Kommireddi <[EMAIL PROTECTED]> wrote:

Thanks Ravi!
>
>
>
>On Tue, Oct 22, 2013 at 12:55 PM, Ravi Prakash <[EMAIL PROTECTED]> wrote:
>
>Hi Prashant!
>>
>>
>>
>>You can set yarn.resourcemanager.max-completed-applicationsin yarn-site.xml of RM to limit the maximum number of apps it keeps track of (It defaults to 10000). You're right that the Heap may also be increased.
>>
>>
>>HTH
>>Ravi
>>
>>
>>
>>
>>On Monday, October 21, 2013 5:54 PM, Prashant Kommireddi <[EMAIL PROTECTED]> wrote:
>>
>>Hello,
>>
>>
>>We are noticing the RM running out of memory in the webapp code. It happens in org.apache.hadoop.yarn.server.resourcemanager.webapp.AppsBlock.renderBlock(Block html).
>>
>>
>>The StringBuilder object "appsTableData" grows too large in this case while appending AppInfo. Ignoring the heap size (this should be fixed if I increased the heapsize for sometime), is there a way to configure the number of AppInfos that should be loaded? Or pagination?
>>
>>
>>Thanks,
>>Prashant
>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB