Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Re: OutofMemoryError when running an YARN application with 25 containers


+
anil gupta 2013-01-15, 06:18
Copy link to this message
-
Re: OutofMemoryError when running an YARN application with 25 containers
How many maps & reduces did your job have? Also, what release are you using? I'd recommend at least 2.0.2-alpha, though we should be able to release 2.0.3-alpha very soon.

Arun

On Jan 14, 2013, at 4:35 AM, Krishna Kishore Bonagiri wrote:

> Hi,
>
>   I am getting the following error in ApplicationMaster.stderr when running an application with around 25 container launches. How can I resolve this issue?
>
> JVMDUMP006I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" - please wait.
> JVMDUMP032I JVM requested Heap dump using '/tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/heapdump.20130114.044646.16631.0001.phd' in response to an event
> JVMDUMP010I Heap dump written to /tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/heapdump.20130114.044646.16631.0001.phd
> JVMDUMP032I JVM requested Java dump using '/tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/javacore.20130114.044646.16631.0002.txt' in response to an event
> JVMDUMP010I Java dump written to /tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/javacore.20130114.044646.16631.0002.txt
> JVMDUMP032I JVM requested Snap dump using '/tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/Snap.20130114.044646.16631.0003.trc' in response to an event
> JVMDUMP010I Snap dump written to /tmp/nm-local-dir/usercache/dsadm/appcache/application_1355219238448_0461/container_1355219238448_0461_01_000001/Snap.20130114.044646.16631.0003.trc
> JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".
> Exception in thread "Thread-7" java.lang.OutOfMemoryError
>         at ApplicationMaster.readMessage(ApplicationMaster.java:241)
>         at ApplicationMaster$SectionLeaderRunnable.run(ApplicationMaster.java:825)
>         at java.lang.Thread.run(Thread.java:736)
>
>
> Thanks,
> Kishore

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB