Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Can't insert data into hbase, OOME.


Copy link to this message
-
Can't insert data into hbase, OOME.
Hi all,

I'm stuck. I can't insert any valuable peace of data into hbase.

Data is something around ~20mil rows (20G). I try to insert them into
nondistributed hbase with 4 parallel jobs.
MR job run until all memory given to hbase is exhaused and then
hbase produces hprof file. As profiler shows, all memory accumulated
in MemStore.kvset.
I don't understand, why hbase doesn't block untill flush memstore.
The same if I give hbase 6Gb or RAM.

6GB gc log http://paste.ubuntu.com/502577/

hadoop: 0.20.2+320
hbase: stumbleupon-20100830

nothing in hbase-site.xml (except hbase.rootdir and zookeeper.quorum).

Andrey.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB