Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HFile block size


Copy link to this message
-
Re: HFile block size
FYI, you can define BLOCKSIZE in your hbase-sites.xml, just like with HBase
to make it global.

Thanks,
James
On Mon, Nov 25, 2013 at 9:08 PM, Azuryy Yu <[EMAIL PROTECTED]> wrote:

> This is no way to declare global property in Phoneix, you have to
> declare BLOCKSIZE
> in each 'create' SQL.
>
> such as:
> "CREATE TABLE IF NOT EXISTS STOCK_SYMBOL(id int, name string)
>  BLOOMFILTER='ROW', VERSIONS='1', BLOCKSIZE => '8192' "
>
>
> On Tue, Nov 26, 2013 at 12:36 PM, Job Thomas <[EMAIL PROTECTED]> wrote:
>
> >
> > Hi Jean ,
> >
> >  Thanks You for the support.
> >
> > we can create table like this , create 'xyz', {NAME => 'cf',  BLOCKSIZE
> =>
> > '8192'} inorder  to set the block size.
> >
> > But I am using phoenix to create and query the table. I want to globaly
> > declare this property to let all table crated  should take this property.
> >
> > My priamry aim is to decrease the random read latency by reducing block
> > size.
> >
> > how can I make that?
> >
> > Best Regards,
> > Job M Thomas
> >
> > ________________________________
> >
> > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > Sent: Tue 11/26/2013 9:28 AM
> > To: user
> > Subject: Re: HFile block size
> >
> >
> >
> > From the code and the JIRAs:
> >
> > hbase.hregion.max.filesize is used to configure the size of a region
> (which
> > can contain more than one HFile)
> >
> > hbase.mapreduce.hfileoutputformat.blocksize come from HBase 8949 (While
> > writing hfiles from HFileOutputFormat forcing blocksize from table
> > schema(HColumnDescriptor).
> >  Even if we configure hbase.mapreduce.hfileoutputformat.blocksize during
> > bulkload/import it
> > will be overridden with actual block size from table schema. )
> >
> > hfile.min.blocksize.size is the old
> > hbase.mapreduce.hfileoutputformat.blocksize (See HBase-3864)
> >
> >
> > 2013/11/25 Job Thomas <[EMAIL PROTECTED]>
> >
> > > Hi all,
> > >
> > > Out of these property , which one is used to set  HFile block size in
> > hbae
> > > 0.94.12
> > >
> > >          hbase.hregion.max.filesize=16384
> > >
> > >          hfile.min.blocksize.size=16384
> > >
> > >          hbase.mapreduce.hfileoutputformat.blocksize=16384
> > >
> > > Best Regards,
> > > Job M Thomas
> > >
> >
> >
> >
>