Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.


+
Steve Lewis 2012-10-05, 09:50
+
Attila Csordas 2012-10-06, 22:20
+
Harsh J 2012-10-07, 05:34
+
Attila Csordas 2012-10-08, 09:50
Copy link to this message
-
Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.
Attila Csordas 2012-10-07, 19:28
<property>
  <name>mapred.tasktracker.map.tasks.maximum</name>
  <value>10</value>
</property>

<property>
  <name>mapred.tasktracker.reduce.tasks.maximum</name>
  <value>6</value>
</property>

Cheers,
Attila

On Sun, Oct 7, 2012 at 6:34 AM, Harsh J <[EMAIL PROTECTED]> wrote:
> Hi,
>
> What is your # of slots per TaskTracker? Your ulimit seems pretty
> high. I'd set it to 1.5x times heap initially, i.e., 6291456 (6 GB)
> and try.
>
> On Sun, Oct 7, 2012 at 3:50 AM, Attila Csordas <[EMAIL PROTECTED]> wrote:
>> some details to this problem:
>>
>> 12/10/05 12:13:27 INFO mapred.JobClient:  map 0% reduce 0%
>> 12/10/05 12:13:40 INFO mapred.JobClient: Task Id :
>> attempt_201210051158_0001_m_000002_0, Status : FAILED
>> java.lang.Throwable: Child Error
>>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
>> Caused by: java.io.IOException: Task process exit with nonzero status of 134.
>>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
>>
>> attempt_201210051158_0001_m_000002_0: #
>> attempt_201210051158_0001_m_000002_0: # There is insufficient memory
>> for the Java Runtime Environment to continue.
>> attempt_201210051158_0001_m_000002_0: # pthread_getattr_np
>>
>> in mapred-site.xml the following memory settings were set after a
>> couple trials to get rid of the problem this way:
>>
>> <property>
>> <name>mapred.child.java.opts</name>
>> <value>-server -Xmx4096M -Djava.net.preferIPv4Stack=true</value>
>> </property>
>>
>> <property>
>> <name>mapred.child.ulimit</name>
>> <value>16777216</value>
>> </property>
>>
>> Cheers,
>> Attila
>>
>>
>>
>> On Fri, Oct 5, 2012 at 10:50 AM, Steve Lewis <[EMAIL PROTECTED]> wrote:
>>> [We get 'There is insufficient memory for the Java Runtime Environment to
>>> continue.'
>>> any time we run any job including the most trivial word count process. It is
>>> true I am generating a jar for a larger job but only running a version of
>>> wordcount that worked well under 0.2
>>> Any bright ideas???
>>> This is a new 1.03 installation and nothing is known to work
>>>
>>> Steven M. Lewis PhD
>>> 4221 105th Ave NE
>>> Kirkland, WA 98033
>>> cell 206-384-1340
>>> skype lordjoe_com
>
>
>
> --
> Harsh J
+
Arpit Gupta 2012-10-07, 19:37
+
Attila Csordas 2012-10-08, 09:45
+
Arpit Gupta 2012-10-08, 15:29
+
Attila Csordas 2012-10-16, 22:22