Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Re: 答复: distcp error.


Copy link to this message
-
Re: 答复: distcp error.
Marcos Ortiz 2012-08-28, 19:03
Have you searched in the Hadoop Jira if there is a seemed problem to this?
This can be a bug.

El 28/08/2012 12:30, Tao escribi锟斤拷:
>
> Hi,
>
> Thanks for your reply.
>
> I have tried between 1.0.3s and 2.0.1s.
>
> Both are failed.
>
> Path contain Chinese character.
>
> *1.0.3 hftp to 1.0.3 hdfs, exception inform is below.*
>
> 12/08/29 00:24:23 INFO tools.DistCp: sourcePathsCount=2
>
> 12/08/29 00:24:23 INFO tools.DistCp: filesToCopyCount=1
>
> 12/08/29 00:24:23 INFO tools.DistCp: bytesToCopyCount=1.2k
>
> 12/08/29 00:24:24 INFO mapred.JobClient: Running job:
> job_201208101345_2203
>
> 12/08/29 00:24:25 INFO mapred.JobClient: map 0% reduce 0%
>
> 12/08/29 00:24:46 INFO mapred.JobClient: Task Id :
> attempt_201208101345_2203_m_000000_0, Status : FAILED
>
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
>
> at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582)
>
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
>
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> 12/08/29 00:25:04 INFO mapred.JobClient: Task Id :
> attempt_201208101345_2203_m_000000_1, Status : FAILED
>
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
>
> at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582)
>
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
>
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> 12/08/29 00:25:19 INFO mapred.JobClient: Task Id :
> attempt_201208101345_2203_m_000000_2, Status : FAILED
>
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
>
> at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582)
>
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
>
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Job complete:
> job_201208101345_2203
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Counters: 6
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Job Counters
>
> 12/08/29 00:25:40 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=66844
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Total time spent by all
> reduces waiting after reserving slots (ms)=0
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Total time spent by all maps
> waiting after reserving slots (ms)=0
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Launched map tasks=4
>
> 12/08/29 00:25:40 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Failed map tasks=1
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Job Failed: # of failed Map
> Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask:
> task_201208101345_2203_m_000000
>
> With failures, global counters are inaccurate; consider running with -i
>
> Copy failed: java.io.IOException: Job failed!
>
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1265)
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION

http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci