Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Hbase memstore manual flush


Copy link to this message
-
Re: Hbase memstore manual flush
>From the master node hbase master stop should also flush everything for
shutdown.

On Tue, Dec 4, 2012 at 10:22 AM, ramkrishna vasudevan <
[EMAIL PROTECTED]> wrote:

> HBaseAdmin has a flush() api that accepts the table name.  This will ensure
> that the data in memory is flushed.
>
> Regards
> Ram
>
> On Tue, Dec 4, 2012 at 8:39 PM, Shengjie Min <[EMAIL PROTECTED]> wrote:
>
> > According to Hbase design, Memstore flush is happened automatically
> behind
> > the theme when it reaches the size limit.
> >
> > In my case, I want to do a hdfs migration, migrating hdfs data from one
> > cluster to another using distcp, I need to make sure there is nothing
> left
> > in-memory before I bring down hbase process in the source cluster. Is
> there
> > anyway we can manually force the flush even tho the memstore hasn't
> reached
> > the limit. Or, stopping hbase will trigger the flush automatically? if
> this
> > is the case, how do I know everything in-memory is flushed successfully
> to
> > HDFS? via metrics(memstoreSize)?
> > --
> > All the best,
> > Shengjie Min
> >
>

--
Kevin O'Dell
Customer Operations Engineer, Cloudera
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB