Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Hbase Region Size


Copy link to this message
-
Re: Hbase Region Size
Jean-Marc Spaggiari 2013-12-02, 14:52
Hi Vineet,

So to get the size you can get the list of stores for the region and call
getStoreSizeUncompressed on each store. I'm not 100% sure this method is
accessible from outside the class. If it's not accessible, might be good to
have an easy way to get this information.

you can take a look at ConstantSizeRegionSplitPolicy,java and Store.java to
see how it's done.

I will take a deeper look when I will get off the plane ;)

JM
2013/12/2 Jean-Marc Spaggiari <[EMAIL PROTECTED]>

> Hum. I need to check but I'm not sure if HBase is doing the MAX_FILESIZE
> check against the compressed size of the region or against the uncompressed
> size. I will guess it's against the compress size. But I will doublecheck
> into the code to confirm.
>
> Are you looking for the compressed size? Or the "regular" size?
>
>
> 2013/12/2 Vineet Mishra <[EMAIL PROTECTED]>
>
>> Actually I am looking for the Size of the Region, and not for the whole
>> table. Although the Hbase internally do the Max file size check to split
>> the Region in a autonomous manner, hence there should be some way to get
>> it.
>>
>>
>> On Mon, Dec 2, 2013 at 7:51 PM, Jean-Marc Spaggiari <
>> [EMAIL PROTECTED]
>> > wrote:
>>
>> > Same for a single region. If it's compressed, you might want to look
>> into
>> > HDFS directly...
>> >
>> >
>> > 2013/12/2 Mike Axiak <[EMAIL PROTECTED]>
>> >
>> > > Are you looking to get the MAX_FILESIZE paramter? If so, there's
>> nothing
>> > in
>> > > the client, but HBaseAdmin has what you need [1].
>> > >
>> > >    HTableDescriptor myDescriptor >> > > hbaseAdmin.getDescriptor(Bytes.toBytes("my-table"));
>> > >    System.out.println("my-table has a max region size of " +
>> > > myDescriptor.getMaxFileSize());
>> > >
>> > >
>> > > 1:
>> > >
>> > >
>> >
>> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HBaseAdmin.html
>> > >
>> > >
>> > > On Mon, Dec 2, 2013 at 9:05 AM, Jean-Marc Spaggiari <
>> > > [EMAIL PROTECTED]
>> > > > wrote:
>> > >
>> > > > Hi Vineet,
>> > > >
>> > > > If you want the entire table size I don't think there is any API for
>> > > that.
>> > > > If you want the size of the table on the disk (compressed) they you
>> are
>> > > > better to use HDFS API.
>> > > >
>> > > > JM
>> > > >
>> > > >
>> > > > 2013/12/2 Vineet Mishra <[EMAIL PROTECTED]>
>> > > >
>> > > > > Hi
>> > > > >
>> > > > > Can Anyone tell me the Java API for getting the Region Size of a
>> > table!
>> > > > >
>> > > > > Thanks!
>> > > > >
>> > > >
>> > >
>> >
>>
>
>