Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Hbase Compression


Copy link to this message
-
Re: Hbase Compression
On flushing we do some cleanup, like removing deleted data that was already
in the MemStore or extra versions. Could it be that you are overwriting
recently written data?

48MB is the size of the Memstore that accumulated while the flushing
happened.

J-D
On Tue, Sep 24, 2013 at 3:50 AM, aiyoh79 <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I am using hbase 0.94.11 and i feel a bit confuse when looking at the log
> file below:
>
> 13/09/24 13:11:00 INFO regionserver.Store: Flushed , sequenceid=687077,
> memsize> 122.1m, into tmp file
> hdfs://192.168.123.123:54310/hbase/usertable/b19289cf9b1400
> c6daddc347337bac03/.tmp/13f0d91efe784372a796585a6c1e05d3
> 13/09/24 13:11:00 INFO regionserver.Store: Added
> hdfs://192.168.123.123:54310/hba
>
> se/usertable/b19289cf9b1400c6daddc347337bac03/family/13f0d91efe784372a796585a6c1
> e05d3, entries=432620, sequenceid=687077, filesize=64.4m
> 13/09/24 13:11:00 INFO regionserver.HRegion: Finished memstore flush of
> ~128.2m/
> 134402240, currentsize=48.0m/50366240 for region
> usertable,user4\xB4\xB0,1379998
> 895119.b19289cf9b1400c6daddc347337bac03. in 1163ms, sequenceid=687077,
> compactio
> n requested=false
>
> It seems like it will first flush into a tmp file and the memsize is
> 122.1m,
> but when it finally added, the size is 64.4m. Lastly, there are 2 more
> parameters which is 128.2m and 48.0m for currentsize.
>
> I never specify hbase.regionserver.codecs preperty in my hbase-site.xml
> file, so is the size difference still because of compression?
>
> Thanks,
>
> aiyoh79
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Hbase-Compression-tp4051122.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB