Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - larger HFile block size for very wide row?


Copy link to this message
-
Re: larger HFile block size for very wide row?
Wei Tan 2014-01-29, 20:50
To be more clear, each KV (cell) is a couple of KB but each row is a
couple of MB. If I need to search through row key, but always fetch rows
as a whole, shall I use a block size larger than the default 64KB?

Thanks,
Wei

---------------------------------
Wei Tan, PhD
Research Staff Member
IBM T. J. Watson Research Center
http://researcher.ibm.com/person/us-wtan

From:   Wei Tan/Watson/IBM@IBMUS
To:     [EMAIL PROTECTED],
Date:   01/29/2014 03:36 PM
Subject:        larger HFile block size for very wide row?

Hi, I have a HBase table where each row has ~1000k columns, ~2K each. My
table scan pattern is to use a row key filter but I need to fetch the
whole row (~1000 k) columns back.

Shall I set HFile block size to be larger than the default 64K?
Thanks,
Wei

---------------------------------
Wei Tan, PhD
Research Staff Member
IBM T. J. Watson Research Center
http://researcher.ibm.com/person/us-wtan