Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> hbase-0.89/trunk: org.apache.hadoop.fs.ChecksumException: Checksum error


Copy link to this message
-
Re: hbase-0.89/trunk: org.apache.hadoop.fs.ChecksumException: Checksum error
hp proliant raid 10 with 4 sas. 15k. smartarray 6i. 2cpu/4core.

2010/9/22 Ryan Rawson <[EMAIL PROTECTED]>:
> generally checksum errors are due to hardware faults of one kind or another.
>
> what is your hardware like?
>
> On Wed, Sep 22, 2010 at 2:08 AM, Andrey Stepachev <[EMAIL PROTECTED]> wrote:
>> But why it is bad? Split/compaction? I make my own RetryResultIterator
>> which reopen scanner on timeout. But what is best way to reopen scanner.
>> Can you point me where i can find all this exceptions? Or may be
>> here already some sort for recoveratble iterator?
>>
>> 2010/9/22 Ryan Rawson <[EMAIL PROTECTED]>:
>>> ah ok i think i get it... basically at this point your scanner is bad
>>> and iterating on it again won't work.  the scanner should probably
>>> self close itself so you get tons of additional exceptions but instead
>>> we dont.
>>>
>>> there is probably a better fix for this, i'll ponder
>>>
>>> On Wed, Sep 22, 2010 at 1:57 AM, Ryan Rawson <[EMAIL PROTECTED]> wrote:
>>>> very strange... looks like a bad block ended up in your scanner and
>>>> subsequent nexts were failing due to that short read.
>>>>
>>>> did you have to kill the regionserver or did things recover and
>>>> continue normally?
>>>>
>>>> -ryan
>>>>
>>>> On Wed, Sep 22, 2010 at 1:37 AM, Andrey Stepachev <[EMAIL PROTECTED]> wrote:
>>>>> Hi All.
>>>>>
>>>>> I get org.apache.hadoop.fs.ChecksumException for a table on heavy
>>>>> write in standalone mode.
>>>>> table tmp.bsn.main created 2010-09-22 10:42:28,860 and then 5 threads
>>>>> writes data to it.
>>>>> At some moment exception thrown.
>>>>>
>>>>> Andrey.
>>>>>
>>>>
>>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB