Is the max region file size the size of the data uncompressed or the max size of the store file? I noticed my store files are ~2.1 gb though I have the max region size set to 4 gb. This is after a major compaction. Also, is the max region size 4 gb in HBase 0.90.4 or can it be larger? The docs say 4 gb but I wanted to confirm that.

Actually, I had pre-created too many regions so most were only half full, I had a couple of regions that were 4gb.

On Feb 17, 2012, at 3:48 PM, Bryan Keller wrote:

> Is the max region file size the size of the data uncompressed or the max size of the store file? I noticed my store files are ~2.1 gb though I have the max region size set to 4 gb. This is after a major compaction. Also, is the max region size 4 gb in HBase 0.90.4 or can it be larger? The docs say 4 gb but I wanted to confirm that.

Hi Bryan
The size is the size of the store file, if the size go above this you will
have a region split. Regarding the size limit, as far I understand this is
because of the HFile format, and in 0.92 is it about 20G.

Mikael.S

On Sat, Feb 18, 2012 at 2:21 AM, Bryan Keller <[EMAIL PROTECTED]> wrote:

> Actually, I had pre-created too many regions so most were only half full,
> I had a couple of regions that were 4gb.
>
> On Feb 17, 2012, at 3:48 PM, Bryan Keller wrote:
>
> > Is the max region file size the size of the data uncompressed or the max
> size of the store file? I noticed my store files are ~2.1 gb though I have
> the max region size set to 4 gb. This is after a major compaction. Also, is
> the max region size 4 gb in HBase 0.90.4 or can it be larger? The docs say
> 4 gb but I wanted to confirm that.
>
>
--
Mikael.S

Bryan, if you're on 0.90.x the advice is to not go above 4gb regions.  The
Hfilev2 format is in 0.92 which better supports larger regions.

On 2/18/12 5:31 PM, "Mikael Sitruk" <[EMAIL PROTECTED]> wrote:

>Hi Bryan
>The size is the size of the store file, if the size go above this you will
>have a region split. Regarding the size limit, as far I understand this is
>because of the HFile format, and in 0.92 is it about 20G.
>
>Mikael.S
>
>On Sat, Feb 18, 2012 at 2:21 AM, Bryan Keller <[EMAIL PROTECTED]> wrote:
>
>> Actually, I had pre-created too many regions so most were only half
>>full,
>> I had a couple of regions that were 4gb.
>>
>> On Feb 17, 2012, at 3:48 PM, Bryan Keller wrote:
>>
>> > Is the max region file size the size of the data uncompressed or the
>>max
>> size of the store file? I noticed my store files are ~2.1 gb though I
>>have
>> the max region size set to 4 gb. This is after a major compaction.
>>Also, is
>> the max region size 4 gb in HBase 0.90.4 or can it be larger? The docs
>>say
>> 4 gb but I wanted to confirm that.
>>
>>
>
>
>--
>Mikael.S