Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Same Map/Reduce works on command BUT it hanges through Oozie withouth any error msg


Copy link to this message
-
Same Map/Reduce works on command BUT it hanges through Oozie withouth any error msg
yaotian 2013-01-26, 06:43
I manually run it in Hadoop. It works.

But as a job i run it through Oozie. The map/reduce hanged withouth No any
error msg.

I checked master and datanode.

===> From the master. i saw:
2013-01-26 06:32:38,517 INFO org.apache.hadoop.mapred.JobTracker: Adding
task (JOB_SETUP) 'attempt_201301251528_0014_r_000004_0' to tip
task_201301251528_0014_r_000004, for tracker 'tracker_datanode1:localhost/
127.0.0.1:45695'
2013-01-26 06:32:44,538 INFO org.apache.hadoop.mapred.JobInProgress: Task
'attempt_201301251528_0014_r_000004_0' has completed
task_201301251528_0014_r_000004 successfully.
2013-01-26 06:33:40,640 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
History file job_201301090834_0089.   Cache size is 0
2013-01-26 06:33:40,640 WARN org.mortbay.log: /jobtaskshistory.jsp:
java.io.FileNotFoundException: File
/data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/11/000000/job_201301090834_0089_1357872144366_hadoop_sorting+locations+per+user
does not exist.
2013-01-26 06:35:17,008 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
History file job_201301090834_0051.   Cache size is 0
2013-01-26 06:35:17,009 WARN org.mortbay.log: /jobtaskshistory.jsp:
java.io.FileNotFoundException: File
/data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/11/000000/job_201301090834_0051_1357870007893_hadoop_oozie%3Alauncher%3AT%3Djava%3AW%3Dmap-reduce-wf%3AA%3Dsort%5Fuser%3A
does not exist.
2013-01-26 06:40:04,251 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
History file job_201301090834_0026.   Cache size is 0
2013-01-26 06:40:04,251 WARN org.mortbay.log: /taskstatshistory.jsp:
java.io.FileNotFoundException: File
/data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/09/000000/job_201301090834_0026_1357722497582_hadoop_oozie%3Alauncher%3AT%3Djava%3AW%3Dmap-reduce-wf%3AA%3Dreport%5Fsta
does not exist.

===> Form the datanode. Just saw
2013-01-26 06:39:11,143 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:39:41,256 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:40:11,371 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:40:41,486 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:41:11,604 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:41:41,724 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:42:11,845 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:42:41,959 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5