Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Re: Is there a way to only scan data in memstore


Copy link to this message
-
Re: Is there a way to only scan data in memstore
lars hofhansl 2013-03-22, 04:19
We should talk.

If you can envision an interface that is faster, maybe we can provide the right shortcut or change things around in the client to access the data at the right stage or format.
________________________________
 From: Snake <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Thursday, March 21, 2013 2:44 AM
Subject: Re: Is there a way to only scan data in memstore
 
We are attempting to implement hbase as data source in drill.  We don't want to use hbase client to scan data(performance consideration). We divided the scan process into two parts, read hfile directly and read data in memstore from region server.
在 2013-3-21,下午5:31, Anoop Sam John 写道:

> How you can be sure abt data will be in memstore only. What if in btw flush happening?   Which version in use?
> In 94.x version (I am not sure abt the .x version no#) there is preStoreScannerOpen() CP hook. This impl can return a KVScanner for a store (In your impl the scanner can be only for Memstore?). Pls see how this hook is being used and how the StoreScanner is being created.
>
> Can you think of control this using TimeRange on Scan ?
>
> -Anoop-
> ________________________________________
> From: Snake [[EMAIL PROTECTED]]
> Sent: Thursday, March 21, 2013 2:35 PM
> To: [EMAIL PROTECTED]
> Subject: Is there a way to only scan data in memstore
>
> Hi,
>
> I just want to scan data in memstore, but I saw InternalScan is private class.  Is there a way i can do it without change the hbase source code?
>
> Thanks,
> Snake