Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Hbase Compression


+
aiyoh79 2013-09-24, 10:50
Copy link to this message
-
Re: Hbase Compression
Ted Yu 2013-09-24, 17:13
memstoreSize of 128.2m was recorded at the beginning
of HRegion#internalFlushcache().

After the flush, memstoreSize became 48.0m.

Cheers
On Tue, Sep 24, 2013 at 3:50 AM, aiyoh79 <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I am using hbase 0.94.11 and i feel a bit confuse when looking at the log
> file below:
>
> 13/09/24 13:11:00 INFO regionserver.Store: Flushed , sequenceid=687077,
> memsize> 122.1m, into tmp file
> hdfs://192.168.123.123:54310/hbase/usertable/b19289cf9b1400
> c6daddc347337bac03/.tmp/13f0d91efe784372a796585a6c1e05d3
> 13/09/24 13:11:00 INFO regionserver.Store: Added
> hdfs://192.168.123.123:54310/hba
>
> se/usertable/b19289cf9b1400c6daddc347337bac03/family/13f0d91efe784372a796585a6c1
> e05d3, entries=432620, sequenceid=687077, filesize=64.4m
> 13/09/24 13:11:00 INFO regionserver.HRegion: Finished memstore flush of
> ~128.2m/
> 134402240, currentsize=48.0m/50366240 for region
> usertable,user4\xB4\xB0,1379998
> 895119.b19289cf9b1400c6daddc347337bac03. in 1163ms, sequenceid=687077,
> compactio
> n requested=false
>
> It seems like it will first flush into a tmp file and the memsize is
> 122.1m,
> but when it finally added, the size is 64.4m. Lastly, there are 2 more
> parameters which is 128.2m and 48.0m for currentsize.
>
> I never specify hbase.regionserver.codecs preperty in my hbase-site.xml
> file, so is the size difference still because of compression?
>
> Thanks,
>
> aiyoh79
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Hbase-Compression-tp4051122.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
+
aiyoh79 2013-09-25, 01:38
+
Jean-Daniel Cryans 2013-09-24, 17:19
+
aiyoh79 2013-09-25, 01:41