Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> java.lang.OutOfMemoryError: Java heap space No matter the size of the input its given


Copy link to this message
-
Re: java.lang.OutOfMemoryError: Java heap space No matter the size of the input its given
Hi ,
Can you see if any of your logic going for an infinite loop in mapper?

On Wed, Apr 11, 2012 at 4:47 AM, SRIKANTH KOMMINENI (RIT Student) <
[EMAIL PROTECTED]> wrote:

> Can you please help me resolve this issue.
>
> The following is the error that I get no matter how small the input the
> program is fed with.
> I tried changing the default heap size of hadoop in the conf/hadoop-env.sh
> but that also did not help.
>
> The following is the error that i get.
>
>
>
> Wrote input for Map #9
> Starting Job
> 12/04/10 19:12:23 WARN mapred.JobClient: No job jar file set.  User classes
> may not be found. See JobConf(Class) or JobConf#setJar(String).
> 12/04/10 19:12:23 INFO mapred.FileInputFormat: Total input paths to process
> : 10
> 12/04/10 19:12:23 INFO mapred.JobClient: Running job: job_local_0001
> 12/04/10 19:12:23 INFO util.ProcessTree: setsid exited with exit code 0
> 12/04/10 19:12:23 INFO mapred.Task:  Using ResourceCalculatorPlugin :
> org.apache.hadoop.util.LinuxResourceCalculatorPlugin@ab444
> 12/04/10 19:12:23 INFO mapred.MapTask: numReduceTasks: 1
> 12/04/10 19:12:23 INFO mapred.MapTask: io.sort.mb = 100
> 12/04/10 19:12:23 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.OutOfMemoryError: Java heap space
> at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:949)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:428)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
> 12/04/10 19:12:24 INFO mapred.JobClient:  map 0% reduce 0%
> 12/04/10 19:12:24 INFO mapred.JobClient: Job complete: job_local_0001
> 12/04/10 19:12:24 INFO mapred.JobClient: Counters: 0
> 12/04/10 19:12:24 INFO mapred.JobClient: Job Failed: NA
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1265)
> at org.apache.hadoop.examples.PiEstimator.estimate(PiEstimator.java:297)
> at org.apache.hadoop.examples.PiEstimator.run(PiEstimator.java:342)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.examples.PiEstimator.main(PiEstimator.java:351)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
>
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
> --
> Srikanth Kommineni,
> Graduate Assistant,
> Dept of Computer Science,
> Rochester Institute of Technology.
>

--
https://github.com/zinnia-phatak-dev/Nectar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB