Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Add Columnsize Filter for Scan Operation


Copy link to this message
-
Re: RE: Add Columnsize Filter for Scan Operation
We need to finish up HBASE-8369

________________________________
 From: Dhaval Shah <[EMAIL PROTECTED]>
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Sent: Thursday, October 24, 2013 4:38 PM
Subject: Re: RE: Add Columnsize Filter for Scan Operation
 

Well that depends on your use case ;)

There are many nuances/code complexities to keep in mind:
- merging results of various HFiles (each region can have.more than one)
- merging results of WAL
- applying delete markers
- how about data which is only in memory of region servers and no where else
- applying bloom filters for efficiency
- what about hbase filters?

At some point you would basically start rewriting an hbase region server on you map reduce job which is not ideal for maintainability.

Do we ever read MySQL data files directly or issue a SQL query? Kind of goes back to the same argument ;)

Sent from Yahoo Mail on Android