Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> IOException:Error Recovery for block


Copy link to this message
-
Re: IOException:Error Recovery for block
Hi,

Can you let us know which Hadoop version you are using?

Thanks
ac

On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:

> Hi All,
>
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
>
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed  because recovery from primary datanode 12.104.0.154:50010 failed 6 times.  Pipeline was 12.104.0.154:50010. Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
>
> Cheers!
> Manoj.
>