Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: Same Map/Reduce works on command BUT it hanges through Oozie withouth any error msg


Copy link to this message
-
Re: Same Map/Reduce works on command BUT it hanges through Oozie withouth any error msg
Yaotian,

*Oozie version?
*More details on what exactly is your workflow action (mapred, java, shell,
etc)
*What is is in the task log of the oozie laucher job for that action?

Thx

On Fri, Jan 25, 2013 at 10:43 PM, yaotian <[EMAIL PROTECTED]> wrote:

> I manually run it in Hadoop. It works.
>
> But as a job i run it through Oozie. The map/reduce hanged withouth No any
> error msg.
>
> I checked master and datanode.
>
> ===> From the master. i saw:
> 2013-01-26 06:32:38,517 INFO org.apache.hadoop.mapred.JobTracker: Adding
> task (JOB_SETUP) 'attempt_201301251528_0014_r_000004_0' to tip
> task_201301251528_0014_r_000004, for tracker 'tracker_datanode1:localhost/
> 127.0.0.1:45695'
> 2013-01-26 06:32:44,538 INFO org.apache.hadoop.mapred.JobInProgress: Task
> 'attempt_201301251528_0014_r_000004_0' has completed
> task_201301251528_0014_r_000004 successfully.
> 2013-01-26 06:33:40,640 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
> History file job_201301090834_0089.   Cache size is 0
> 2013-01-26 06:33:40,640 WARN org.mortbay.log: /jobtaskshistory.jsp:
> java.io.FileNotFoundException: File
> /data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/11/000000/job_201301090834_0089_1357872144366_hadoop_sorting+locations+per+user
> does not exist.
> 2013-01-26 06:35:17,008 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
> History file job_201301090834_0051.   Cache size is 0
> 2013-01-26 06:35:17,009 WARN org.mortbay.log: /jobtaskshistory.jsp:
> java.io.FileNotFoundException: File
> /data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/11/000000/job_201301090834_0051_1357870007893_hadoop_oozie%3Alauncher%3AT%3Djava%3AW%3Dmap-reduce-wf%3AA%3Dsort%5Fuser%3A
> does not exist.
> 2013-01-26 06:40:04,251 INFO org.apache.hadoop.mapred.JSPUtil: Loading Job
> History file job_201301090834_0026.   Cache size is 0
> 2013-01-26 06:40:04,251 WARN org.mortbay.log: /taskstatshistory.jsp:
> java.io.FileNotFoundException: File
> /data/hadoop-0.20.205.0/logs/history/done/version-1/master_1357720451772_/2013/01/09/000000/job_201301090834_0026_1357722497582_hadoop_oozie%3Alauncher%3AT%3Djava%3AW%3Dmap-reduce-wf%3AA%3Dreport%5Fsta
> does not exist.
>
> ===> Form the datanode. Just saw
> 2013-01-26 06:39:11,143 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:39:41,256 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:40:11,371 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:40:41,486 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:41:11,604 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:41:41,724 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:42:11,845 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
> 2013-01-26 06:42:41,959 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201301251528_0013_m_000000_0 0.0%
> hdfs://master:9000/user/hadoop/oozie-hado/0000007-130125091701134-oozie-hado-W/sort_user--java/input/dummy.txt:0+5
Alejandro
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB