Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Same Map/Reduce works on command BUT it hanges through Oozie withouth any error msg


Copy link to this message
-
Same Map/Reduce works on command BUT it hanges through Oozie withouth any error msg
I manually run it in Hadoop. It works.

But as a job i run it through Oozie. The map/reduce hanged withouth No any
error msg.

I checked master and datanode.

===> From the master. i saw:
2013-01-26 06:32:38,517 INFO org.apache.hadoop.mapred.JobTracker: Adding
task (JOB_SETUP) 'attempt_201301251528_0014_r_000004_0' to tip
task_201301251528_0014_r_000004, for tracker 'tracker_datanode1:localhost/
127.0.0.1:45695'
2013-01-26 06:32:44,538 INFO org.apache.hadoop.mapred.JobInProgress: Task
'attempt_201301251528_0014_r_000004_0' has completed
task_201301251528_0014_r_000004 successfully.
2013-01-26 06:33:40,640 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
History file job_201301090834_0089.   Cache size is 0
2013-01-26 06:33:40,640 WARN org.mortbay.log: /jobtaskshistory.jsp:
java.io.FileNotFoundException: File
/data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/11/000000/job_201301090834_0089_1357872144366_hadoop_sorting+locations+per+user
does not exist.
2013-01-26 06:35:17,008 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
History file job_201301090834_0051.   Cache size is 0
2013-01-26 06:35:17,009 WARN org.mortbay.log: /jobtaskshistory.jsp:
java.io.FileNotFoundException: File
/data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/11/000000/job_201301090834_0051_1357870007893_hadoop_oozie%3Alauncher%3AT%3Djava%3AW%3Dmap-reduce-wf%3AA%3Dsort%5Fuser%3A
does not exist.
2013-01-26 06:40:04,251 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
History file job_201301090834_0026.   Cache size is 0
2013-01-26 06:40:04,251 WARN org.mortbay.log: /taskstatshistory.jsp:
java.io.FileNotFoundException: File
/data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/09/000000/job_201301090834_0026_1357722497582_hadoop_oozie%3Alauncher%3AT%3Djava%3AW%3Dmap-reduce-wf%3AA%3Dreport%5Fsta
does not exist.

===> Form the datanode. Just saw
2013-01-26 06:39:11,143 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:39:41,256 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:40:11,371 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:40:41,486 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:41:11,604 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:41:41,724 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:42:11,845 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
2013-01-26 06:42:41,959 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201301251528_0013_m_000000_0 0.0%
hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB