Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HFile block size


Copy link to this message
-
Re: HFile block size
This is no way to declare global property in Phoneix, you have to
declare BLOCKSIZE
in each 'create' SQL.

such as:
"CREATE TABLE IF NOT EXISTS STOCK_SYMBOL(id int, name string)
 BLOOMFILTER='ROW', VERSIONS='1', BLOCKSIZE => '8192' "
On Tue, Nov 26, 2013 at 12:36 PM, Job Thomas <[EMAIL PROTECTED]> wrote:

>
> Hi Jean ,
>
>  Thanks You for the support.
>
> we can create table like this , create 'xyz', {NAME => 'cf',  BLOCKSIZE =>
> '8192'} inorder  to set the block size.
>
> But I am using phoenix to create and query the table. I want to globaly
> declare this property to let all table crated  should take this property.
>
> My priamry aim is to decrease the random read latency by reducing block
> size.
>
> how can I make that?
>
> Best Regards,
> Job M Thomas
>
> ________________________________
>
> From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> Sent: Tue 11/26/2013 9:28 AM
> To: user
> Subject: Re: HFile block size
>
>
>
> From the code and the JIRAs:
>
> hbase.hregion.max.filesize is used to configure the size of a region (which
> can contain more than one HFile)
>
> hbase.mapreduce.hfileoutputformat.blocksize come from HBase 8949 (While
> writing hfiles from HFileOutputFormat forcing blocksize from table
> schema(HColumnDescriptor).
>  Even if we configure hbase.mapreduce.hfileoutputformat.blocksize during
> bulkload/import it
> will be overridden with actual block size from table schema. )
>
> hfile.min.blocksize.size is the old
> hbase.mapreduce.hfileoutputformat.blocksize (See HBase-3864)
>
>
> 2013/11/25 Job Thomas <[EMAIL PROTECTED]>
>
> > Hi all,
> >
> > Out of these property , which one is used to set  HFile block size in
> hbae
> > 0.94.12
> >
> >          hbase.hregion.max.filesize=16384
> >
> >          hfile.min.blocksize.size=16384
> >
> >          hbase.mapreduce.hfileoutputformat.blocksize=16384
> >
> > Best Regards,
> > Job M Thomas
> >
>
>
>