Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Map Task Hanging for long time for commit


Copy link to this message
-
Map Task Hanging for long time for commit
Subroto 2012-07-04, 09:01
I am using 0.20.2 hadoop and I find many of my Tasks are getting timed out. The task Time out is set to 10 minutes(default) :

Caused by: java.lang.RuntimeException: tasktracker: Task attempt_201206280317_0052_m_000000_0 failed to report status for 950 seconds. Killing!

the tasks are waiting at the point:
Thread[main,5,main]
at java.lang.Thread.sleep(Native Method)
at org.apache.hadoop.mapred.Task.commit(Task.java:954)
at org.apache.hadoop.mapred.Task.done(Task.java:845)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
The last line from syslog is:
2012-07-03 01:12:53,729 INFO org.apache.hadoop.mapred.Task: Task:attempt_201206280317_0052_m_000000_3 is done. And is in the process of commiting

Is there any problem with my Hadoop Installation or there is a problem with Hadoop?

Cheers,
Subroto Sanyal