Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Re: Same Map/Reduce works on command BUT it hanges through Oozie withouth any error msg


Copy link to this message
-
Re: Same Map/Reduce works on command BUT it hanges through Oozie withouth any error msg
Yaotian,

*Oozie version?
*More details on what exactly is your workflow action (mapred, java, shell,
etc)
*What is is in the task log of the oozie laucher job for that action?

Thx

On Fri, Jan 25, 2013 at 10:43 PM, yaotian <[EMAIL PROTECTED]> wrote:

> I manually run it in Hadoop. It works.
>
> But as a job i run it through Oozie. The map/reduce hanged withouth No any
> error msg.
>
> I checked master and datanode.
>
> ===> From the master. i saw:
> 2013-01-26 06:32:38,517 INFO org.apache.hadoop.mapred.JobTracker: Adding
> task (JOB_SETUP) 'attempt_201301251528_0014_r_000004_0' to tip
> task_201301251528_0014_r_000004, for tracker 'tracker_datanode1:localhost/
> 127.0.0.1:45695'
> 2013-01-26 06:32:44,538 INFO org.apache.hadoop.mapred.JobInProgress: Task
> 'attempt_201301251528_0014_r_000004_0' has completed
> task_201301251528_0014_r_000004 successfully.
> 2013-01-26 06:33:40,640 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
> History file job_201301090834_0089.   Cache size is 0
> 2013-01-26 06:33:40,640 WARN org.mortbay.log: /jobtaskshistory.jsp:
> java.io.FileNotFoundException: File
> /data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/11/000000/job_201301090834_0089_1357872144366_hadoop_sorting+locations+per+user
> does not exist.
> 2013-01-26 06:35:17,008 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
> History file job_201301090834_0051.   Cache size is 0
> 2013-01-26 06:35:17,009 WARN org.mortbay.log: /jobtaskshistory.jsp:
> java.io.FileNotFoundException: File
> /data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/11/000000/job_201301090834_0051_1357870007893_hadoop_oozie%3Alauncher%3AT%3Djava%3AW%3Dmap-reduce-wf%3AA%3Dsort%5Fuser%3A
> does not exist.
> 2013-01-26 06:40:04,251 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
> History file job_201301090834_0026.   Cache size is 0
> 2013-01-26 06:40:04,251 WARN org.mortbay.log: /taskstatshistory.jsp:
> java.io.FileNotFoundException: File
> /data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/09/000000/job_201301090834_0026_1357722497582_hadoop_oozie%3Alauncher%3AT%3Djava%3AW%3Dmap-reduce-wf%3AA%3Dreport%5Fsta
> does not exist.
>
> ===> Form the datanode. Just saw
> 2013-01-26 06:39:11,143 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:39:41,256 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:40:11,371 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:40:41,486 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:41:11,604 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:41:41,724 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:42:11,845 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:42:41,959 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
Alejandro