Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: 答复: distcp error.


Copy link to this message
-
Re: 答复: distcp error.
Have you searched in the Hadoop Jira if there is a seemed problem to this?
This can be a bug.

El 28/08/2012 12:30, Tao escribi锟斤拷:
>
> Hi,
>
> Thanks for your reply.
>
> I have tried between 1.0.3s and 2.0.1s.
>
> Both are failed.
>
> Path contain Chinese character.
>
> *1.0.3 hftp to 1.0.3 hdfs, exception inform is below.*
>
> 12/08/29 00:24:23 INFO tools.DistCp: sourcePathsCount=2
>
> 12/08/29 00:24:23 INFO tools.DistCp: filesToCopyCount=1
>
> 12/08/29 00:24:23 INFO tools.DistCp: bytesToCopyCount=1.2k
>
> 12/08/29 00:24:24 INFO mapred.JobClient: Running job:
> job_201208101345_2203
>
> 12/08/29 00:24:25 INFO mapred.JobClient: map 0% reduce 0%
>
> 12/08/29 00:24:46 INFO mapred.JobClient: Task Id :
> attempt_201208101345_2203_m_000000_0, Status : FAILED
>
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
>
> at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582)
>
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
>
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> 12/08/29 00:25:04 INFO mapred.JobClient: Task Id :
> attempt_201208101345_2203_m_000000_1, Status : FAILED
>
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
>
> at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582)
>
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
>
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> 12/08/29 00:25:19 INFO mapred.JobClient: Task Id :
> attempt_201208101345_2203_m_000000_2, Status : FAILED
>
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
>
> at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582)
>
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
>
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Job complete:
> job_201208101345_2203
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Counters: 6
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Job Counters
>
> 12/08/29 00:25:40 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=66844
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Total time spent by all
> reduces waiting after reserving slots (ms)=0
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Total time spent by all maps
> waiting after reserving slots (ms)=0
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Launched map tasks=4
>
> 12/08/29 00:25:40 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Failed map tasks=1
>
> 12/08/29 00:25:40 INFO mapred.JobClient: Job Failed: # of failed Map
> Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask:
> task_201208101345_2203_m_000000
>
> With failures, global counters are inaccurate; consider running with -i
>
> Copy failed: java.io.IOException: Job failed!
>
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1265)
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION

http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB