Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HFile block size


Copy link to this message
-
Re: HFile block size
This is no way to declare global property in Phoneix, you have to
declare BLOCKSIZE
in each 'create' SQL.

such as:
"CREATE TABLE IF NOT EXISTS STOCK_SYMBOL(id int, name string)
 BLOOMFILTER='ROW', VERSIONS='1', BLOCKSIZE => '8192' "
On Tue, Nov 26, 2013 at 12:36 PM, Job Thomas <[EMAIL PROTECTED]> wrote:

>
> Hi Jean ,
>
>  Thanks You for the support.
>
> we can create table like this , create 'xyz', {NAME => 'cf',  BLOCKSIZE =>
> '8192'} inorder  to set the block size.
>
> But I am using phoenix to create and query the table. I want to globaly
> declare this property to let all table crated  should take this property.
>
> My priamry aim is to decrease the random read latency by reducing block
> size.
>
> how can I make that?
>
> Best Regards,
> Job M Thomas
>
> ________________________________
>
> From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> Sent: Tue 11/26/2013 9:28 AM
> To: user
> Subject: Re: HFile block size
>
>
>
> From the code and the JIRAs:
>
> hbase.hregion.max.filesize is used to configure the size of a region (which
> can contain more than one HFile)
>
> hbase.mapreduce.hfileoutputformat.blocksize come from HBase 8949 (While
> writing hfiles from HFileOutputFormat forcing blocksize from table
> schema(HColumnDescriptor).
>  Even if we configure hbase.mapreduce.hfileoutputformat.blocksize during
> bulkload/import it
> will be overridden with actual block size from table schema. )
>
> hfile.min.blocksize.size is the old
> hbase.mapreduce.hfileoutputformat.blocksize (See HBase-3864)
>
>
> 2013/11/25 Job Thomas <[EMAIL PROTECTED]>
>
> > Hi all,
> >
> > Out of these property , which one is used to set  HFile block size in
> hbae
> > 0.94.12
> >
> >          hbase.hregion.max.filesize=16384
> >
> >          hfile.min.blocksize.size=16384
> >
> >          hbase.mapreduce.hfileoutputformat.blocksize=16384
> >
> > Best Regards,
> > Job M Thomas
> >
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB