Hi All,

When grepping the error logs i could see the below for a job which process
some 500GB of data. What would be the cause and how to avoid it further?
java.io.IOException: Error Recovery for block
blk_4907953961673137346_1929435 failed  because recovery from primary
datanode 12.104.0.154:50010 failed 6 times.  Pipeline was
12.104.0.154:50010. Aborting...
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
Cheers!
Manoj.

Hi,

Can you let us know which Hadoop version you are using?

Thanks
ac

On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:

> Hi All,
>
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
>
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed  because recovery from primary datanode 12.104.0.154:50010 failed 6 times.  Pipeline was 12.104.0.154:50010. Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
>
> Cheers!
> Manoj.
>

Hi,
Am using cdh3u1, hadoop 0.20.2.

Thanks in advance.
On 9 Dec 2012 17:21, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> wrote: