Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Scan performance on compressed column families


Copy link to this message
-
Re: Scan performance on compressed column families
*BUMP*

Sorry,

/David

On Sat, Nov 3, 2012 at 3:57 PM, David Koch <[EMAIL PROTECTED]> wrote:

> Hello,
>
> Are scans faster when compression is activated? The HBase book by Lars
> George seems to suggest so (p424, Section on "Compression" in chapter
> "Performance Tuning").
>
> "... compression usually will yield overall better performance, because
> the overhead of the CPU performing the compression and de- compression is
> less than what is required to read more data from disk."
>
> I searched around for a bit and found this:
> http://gbif.blogspot.fr/2012/02/performance-evaluation-of-hbase.html. The
> author conducted a series of scan performance tests on tables of up to
> 200million rows and found that compression actually slowed down read
> performance slightly - albeit at lower CPU load.
>
> Thank you,
>
> /David
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB