Can you let us know which Hadoop version you are using?
On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:
> Hi All,
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed because recovery from primary datanode 18.104.22.168:50010 failed 6 times. Pipeline was 22.214.171.124:50010. Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)