Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> checksum error


+
Brahma Reddy Battula 2012-04-30, 07:07
+
Srikanth 2012-04-30, 07:29
Thanks for your response.

Are you telling while reading or writing a file make RF=0..?

Anyway write will fail if we make RF=0 since min replica is one by default.

Coming read I am getting eof exception even RF=0;

Here doubt is actually block got corrupted (I checked using fsck and even NN UI also shows block got corrupted)

After reverting changes what ever changes I did.

Read is successfull by using fsshell commands(cat,text and get)..Only readfully throwing EOF
Please correct me If I am wrong.

Thanks And Regards

Brahma Reddy
________________________________
From: Srikanth [[EMAIL PROTECTED]]
Sent: Monday, April 30, 2012 3:29 PM
To: [EMAIL PROTECTED]
Subject: Re: checksum error

Hi,

When you say replication factor=1 it is trying to look for another data node to store the replica of what is stored in the only data node you have created.

Try using replication factor=0.
Srikanth Kommineni

On Apr 30, 2012, at 3:07, Brahma Reddy Battula <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

Hi
I have started hadoop cluster with one NameNode And one DataNode and written one file with replication factor one.

 Now Edited((To get check-sum error)) written file in DN where block is located(physically).

Then I tried to read file ,then I got could not obtain block since block got corrupted and check-sum error from DN logs.

After that I removed what ever I edited from block .

Then I try to read file,here I am able to read by using fsshell commands even though block got corrupted(by fsck report)..But I am getting eof execption using readfully api.

After reverting not getting any checksum error from DN logs.
Please let me know the behavior once revert back to original
Thanks And Regards

Brahma Reddy
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB