Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - why my terasort job become a local job?


Copy link to this message
-
why my terasort job become a local job?
ch huang 2013-11-26, 05:27
hi,maillist:
          i run terasort in my hadoop cluster,and it run as a local job,i
do not know why ,anyone can help?

i use hadoop version is CDH4.4

# sudo -u hdfs hadoop jar
/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.4.0.jar
teragen 10000000 /alex/terasort/10G-input
......

13/11/26 11:57:39 INFO mapred.Task:
Task:attempt_local321416814_0001_m_000000_0 is done. And is in the process
of commiting
13/11/26 11:57:39 INFO mapred.LocalJobRunner:
13/11/26 11:57:39 INFO mapred.Task: Task
attempt_local321416814_0001_m_000000_0 is allowed to commit now
13/11/26 11:57:39 INFO mapred.FileOutputCommitter: Saved output of task
'attempt_local321416814_0001_m_000000_0' to
hdfs://product/alex/terasort/10G-input
13/11/26 11:57:39 INFO mapred.LocalJobRunner:
13/11/26 11:57:39 INFO mapred.Task: Task
'attempt_local321416814_0001_m_000000_0' done.
13/11/26 11:57:39 INFO mapred.LocalJobRunner: Finishing task:
attempt_local321416814_0001_m_000000_0
13/11/26 11:57:39 INFO mapred.LocalJobRunner: Map task executor complete.
13/11/26 11:57:40 INFO mapred.JobClient:  map 100% reduce 0%
13/11/26 11:57:40 INFO mapred.JobClient: Job complete:
job_local321416814_0001
13/11/26 11:57:40 INFO mapred.JobClient: Counters: 19