HBase, mail # user - Re: larger HFile block size for very wide row? - 2014-01-29, 20:50
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: larger HFile block size for very wide row?
To be more clear, each KV (cell) is a couple of KB but each row is a
couple of MB. If I need to search through row key, but always fetch rows
as a whole, shall I use a block size larger than the default 64KB?

Thanks,
Wei

Wei Tan, PhD
Research Staff Member
IBM T. J. Watson Research Center
http://researcher.ibm.com/person/us-wtan

From:   Wei Tan/Watson/IBM@IBMUS
To:     [EMAIL PROTECTED],
Date:   01/29/2014 03:36 PM
Subject:        larger HFile block size for very wide row?

Hi, I have a HBase table where each row has ~1000k columns, ~2K each. My
table scan pattern is to use a row key filter but I need to fetch the
whole row (~1000 k) columns back.

Shall I set HFile block size to be larger than the default 64K?
Thanks,
Wei

Wei Tan, PhD
Research Staff Member
IBM T. J. Watson Research Center
http://researcher.ibm.com/person/us-wtan

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB