Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Meaning of storefileIndexSize


Copy link to this message
-
Re: Meaning of storefileIndexSize
Hi,

after some tuning, like increasing the hfile block size to 128KB,  I
have noticed that the storefileIndexSize is now half of what it was
before (~250). Do storefileIndexSize is the size of the in-memory hfile
block index ?

Thanks
--
Renaud Delbru

On 17/05/10 15:27, Renaud Delbru wrote:
> Hi,
>
> I would like to understand the meaning of the storefileIndexSize
> metric, could someone point me to a definition or explain me what does
> that mean ?
>
> Also, we are performing a large table import (90M rows, size of the
> row varying between hundreds of kb to 8 MB), and we are encountering
> memory problem (OOME). My observation is that it always happens after
> a while, when the storefileIndexSize starts to be large (> 500). Is
> there a way to reduce it ?
>
> Thanks,
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB