Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> IOException:Error Recovery for block


Copy link to this message
-
Re: IOException:Error Recovery for block
Hi,

Can you let us know which Hadoop version you are using?

Thanks
ac

On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:

> Hi All,
>
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
>
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed  because recovery from primary datanode 12.104.0.154:50010 failed 6 times.  Pipeline was 12.104.0.154:50010. Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
>
> Cheers!
> Manoj.
>

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB