Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Map Task Hanging for long time for commit


Copy link to this message
-
Map Task Hanging for long time for commit
I am using 0.20.2 hadoop and I find many of my Tasks are getting timed out. The task Time out is set to 10 minutes(default) :

Caused by: java.lang.RuntimeException: tasktracker: Task attempt_201206280317_0052_m_000000_0 failed to report status for 950 seconds. Killing!

the tasks are waiting at the point:
Thread[main,5,main]
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.mapred.Task.commit(Task.java:954)
at org.apache.hadoop.mapred.Task.done(Task.java:845)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
The last line from syslog is:
2012-07-03 01:12:53,729 INFO org.apache.hadoop.mapred.Task: Task:attempt_201206280317_0052_m_000000_3 is done. And is in the process of commiting

Is there any problem with my Hadoop Installation or there is a problem with Hadoop?

Cheers,
Subroto Sanyal
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB