Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> IOException:Error Recovery for block


Copy link to this message
-
IOException:Error Recovery for block
Hi All,

When grepping the error logs i could see the below for a job which process
some 500GB of data. What would be the cause and how to avoid it further?
java.io.IOException: Error Recovery for block
blk_4907953961673137346_1929435 failed  because recovery from primary
datanode 12.104.0.154:50010 failed 6 times.  Pipeline was
12.104.0.154:50010. Aborting...
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
Cheers!
Manoj.