Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: IOException:Error Recovery for block

Manoj Babu 2012-12-09, 14:13
Copy link to this message
IOException:Error Recovery for block
Hi All,

When grepping the error logs i could see the below for a job which process
some 500GB of data. What would be the cause and how to avoid it further?
java.io.IOException: Error Recovery for block
blk_4907953961673137346_1929435 failed  because recovery from primary
datanode failed 6 times.  Pipeline was Aborting...
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
ac@...) 2012-12-09, 11:51