Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Hbase Compression


Copy link to this message
-
Re: Hbase Compression
memstoreSize of 128.2m was recorded at the beginning
of HRegion#internalFlushcache().

After the flush, memstoreSize became 48.0m.

Cheers
On Tue, Sep 24, 2013 at 3:50 AM, aiyoh79 <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I am using hbase 0.94.11 and i feel a bit confuse when looking at the log
> file below:
>
> 13/09/24 13:11:00 INFO regionserver.Store: Flushed , sequenceid=687077,
> memsize> 122.1m, into tmp file
> hdfs://192.168.123.123:54310/hbase/usertable/b19289cf9b1400
> c6daddc347337bac03/.tmp/13f0d91efe784372a796585a6c1e05d3
> 13/09/24 13:11:00 INFO regionserver.Store: Added
> hdfs://192.168.123.123:54310/hba
>
> se/usertable/b19289cf9b1400c6daddc347337bac03/family/13f0d91efe784372a796585a6c1
> e05d3, entries=432620, sequenceid=687077, filesize=64.4m
> 13/09/24 13:11:00 INFO regionserver.HRegion: Finished memstore flush of
> ~128.2m/
> 134402240, currentsize=48.0m/50366240 for region
> usertable,user4\xB4\xB0,1379998
> 895119.b19289cf9b1400c6daddc347337bac03. in 1163ms, sequenceid=687077,
> compactio
> n requested=false
>
> It seems like it will first flush into a tmp file and the memsize is
> 122.1m,
> but when it finally added, the size is 64.4m. Lastly, there are 2 more
> parameters which is 128.2m and 48.0m for currentsize.
>
> I never specify hbase.regionserver.codecs preperty in my hbase-site.xml
> file, so is the size difference still because of compression?
>
> Thanks,
>
> aiyoh79
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Hbase-Compression-tp4051122.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB