Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Large Puts in MR job


Copy link to this message
-
Re: Large Puts in MR job
If you are creating 1 big put object, how would auto flush help you? In theory you would run out of memory before you do a table.put() anyways. Am I missing something?

Why don't you split your put into smaller puts and let the deferred flush do its job? Do you need all the kv's to be flushed at the same time?

Technically you can create your own hbase client in setup() but I don't know if that's going to solve your issue

Sent from Yahoo Mail on Android

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB