Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Error:java heap size


Copy link to this message
-
RE: Error:java heap size
Devaraj k 2013-06-25, 09:38
Hi Ramya,

We need to change the –Xmx value for your Job tasks according to the memory allocating for map/reduce containers.

You can pass the –Xmx value for map and reduce yarn child’s using configurations "mapreduce.map.java.opts" and "mapreduce.reduce.java.opts".

If you are allocating 2GB for map container, you can probably pass the same value as –Xmx for the  mapreduce.map.java.opts and same way for reducer as well.
Thanks
Devaraj k

From: Ramya S [mailto:[EMAIL PROTECTED]]
Sent: 25 June 2013 14:39
To: [EMAIL PROTECTED]
Subject: RE: Error:java heap size
Hi,

Error is in AM log, which is as follows:

  *   FATAL [IPC Server handler 10 on 49363] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1372143291407_0003_m_000001_0 - exited : Java heap space

  *    INFO [IPC Server handler 10 on 49363] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1372143291407_0003_m_000001_0: Error: Java heap space

  *   INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1372143291407_0003_m_000001_0: Error: Java heap space
Thanks,
Ramya
________________________________
From: Devaraj k [mailto:[EMAIL PROTECTED]]
Sent: Tue 6/25/2013 2:09 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: RE: Error:java heap size
Hi Ramya,

Where did you get the java heap size error?

Could you see the error in client side/RM/AM log? What is the detailed error?

Thanks
Devaraj k

From: Ramya S [mailto:[EMAIL PROTECTED]]
Sent: 25 June 2013 13:10
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Error:java heap size

Hi,

I am using hadoop-2.0.0-cdh4.3.0 version (YARN) and when i tried to run a MR job(6gb file) i got yhe following error:

ERROR: java heap size

Plese give me a solution to solve this...

Ramya