Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> IOException:Error Recovery for block

Copy link to this message
Re: IOException:Error Recovery for block

Can you let us know which Hadoop version you are using?


On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:

> Hi All,
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed  because recovery from primary datanode failed 6 times.  Pipeline was Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
> Cheers!
> Manoj.