Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Creation of symlink from failed


Copy link to this message
-
Creation of symlink from failed
Hi All ,
I am trying to run a simple steaming command as mentioned below .

 bin/hadoop jar
/windows/Hadoop/hadoop-1.2.1/contrib/streaming/hadoop-streaming-1.2.1.jar
-input /usr/pradeep/input/'Good words' -output /usr/pradeep/output mapper
/bin/cat reducer /bin/wc -w

I am getting below as message in the error file

packageJobJar: [/tmp/hadoop-root/hadoop-unjar3249316336279467583/] []
/tmp/streamjob1400561611088699684.jar tmpDir=null
13/08/27 23:55:54 INFO util.NativeCodeLoader: Loaded the native-hadoop
library
13/08/27 23:55:54 WARN snappy.LoadSnappy: Snappy native library not loaded
13/08/27 23:55:54 INFO mapred.FileInputFormat: Total input paths to process
: 1
13/08/27 23:55:55 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-root/mapred/local]
13/08/27 23:55:55 INFO streaming.StreamJob: Running job:
job_201308272335_0004
13/08/27 23:55:55 INFO streaming.StreamJob: To kill this job, run:
13/08/27 23:55:55 INFO streaming.StreamJob:
/windows/Hadoop/hadoop-1.2.1/libexec/../bin/hadoop job
-Dmapred.job.tracker=localhost:9001 -kill job_201308272335_0004
13/08/27 23:55:55 INFO streaming.StreamJob: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201308272335_0004
13/08/27 23:55:56 INFO streaming.StreamJob:  map 0%  reduce 0%
13/08/27 23:56:21 INFO streaming.StreamJob:  map 100%  reduce 100%
13/08/27 23:56:21 INFO streaming.StreamJob: To kill this job, run:
13/08/27 23:56:21 INFO streaming.StreamJob:
/windows/Hadoop/hadoop-1.2.1/libexec/../bin/hadoop job
-Dmapred.job.tracker=localhost:9001 -kill job_201308272335_0004
13/08/27 23:56:21 INFO streaming.StreamJob: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201308272335_0004
13/08/27 23:56:21 ERROR streaming.StreamJob: Job not successful. Error:
JobCleanup Task Failure, Task: task_201308272335_0004_m_000002
13/08/27 23:56:21 INFO streaming.StreamJob: killJob...
Streaming Command Failed!

I checked the log and this is what i found :
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201308272335_0004_m_000002"
TASK_ATTEMPT_ID="attempt_201308272335_0004_m_000002_0" TASK_STATUS="FAILED"
FINISH_TIME="1377627971824" HOSTNAME="pradeep-pc"
ERROR="java\.lang\.Throwable: Child Error
    at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:271)
Caused by: java\.io\.IOException: Creation of symlink from
/windows/Hadoop/hadoop-1\.2\.1/libexec/\.\./logs/userlogs/job_201308272335_0004/attempt_201308272335_0004_m_000002_0
to
/tmp/hadoop-root/mapred/local/userlogs/job_201308272335_0004/attempt_201308272335_0004_m_000002_0
failed\.
    at
org\.apache\.hadoop\.mapred\.TaskLog\.createTaskAttemptLogDir(TaskLog\.java:110)
    at
org\.apache\.hadoop\.mapred\.DefaultTaskController\.createLogDir(DefaultTaskController\.java:71)
    at
org\.apache\.hadoop\.mapred\.TaskRunner\.prepareLogFiles(TaskRunner\.java:316)
    at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:228)

Cant understand the reason for such error .Everything seems to be fine
.Would appreicate any help in this respect .

Regards
Pradeep Singh
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB