Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HBase checksum vs HDFS checksum


Copy link to this message
-
Re: HBase checksum vs HDFS checksum
On Tue, Apr 29, 2014 at 11:53 AM, Stack <[EMAIL PROTECTED]> wrote:
Correction: we seem to always write hbase checksums inline with the data.
 See
http://hbase.apache.org/xref/org/apache/hadoop/hbase/regionserver/HStore.html#901
The HBase checksums are always present.  The flag then is just about
whether they are used at read time.  If so, at read time, we ask for a
stream from HDFS that does not validate checksums (if an error on this
stream, we reopen asking HDFS to do checksum validation).

St.Ack
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB