Liu, Raymond
2013-02-20, 01:01
Ted Yu
2013-02-20, 01:08
Liu, Raymond
2013-02-20, 01:16
Liu, Raymond
2013-02-20, 02:35
Jean-Marc Spaggiari
2013-02-20, 02:58
Ted Yu
2013-02-20, 03:23
Liu, Raymond
2013-02-20, 03:40
Marcos Ortiz
2013-02-20, 03:43
Ted Yu
2013-02-20, 03:45
Liu, Raymond
2013-02-20, 03:48
Liu, Raymond
2013-02-20, 03:49
Ted Yu
2013-02-20, 03:51
Liu, Raymond
2013-02-20, 03:55
Ted Yu
2013-02-20, 04:31
Liu, Raymond
2013-02-20, 05:52
Jean-Marc Spaggiari
2013-02-20, 12:19
Ted Yu
2013-02-20, 15:07
-
Is there any way to balance one table?Liu, Raymond 2013-02-20, 01:01
Hi
Is there any way to balance just one table? I found one of my table is not balanced, while all the other table is balanced. So I want to fix this table.
Best Regards,
Raymond Liu
Is there any way to balance just one table? I found one of my table is not balanced, while all the other table is balanced. So I want to fix this table.
Best Regards,
Raymond Liu
-
Re: Is there any way to balance one table?Ted Yu 2013-02-20, 01:08
What version of HBase are you using ?
0.94 has per-table load balancing.
Cheers
On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> Hi
>
> Is there any way to balance just one table? I found one of my table is not
> balanced, while all the other table is balanced. So I want to fix this
> table.
>
> Best Regards,
> Raymond Liu
>
>
0.94 has per-table load balancing.
Cheers
On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> Hi
>
> Is there any way to balance just one table? I found one of my table is not
> balanced, while all the other table is balanced. So I want to fix this
> table.
>
> Best Regards,
> Raymond Liu
>
>
-
RE: Is there any way to balance one table?Liu, Raymond 2013-02-20, 01:16
0.94.1
Any cmd in shell? Or I need to change balance threshold to 0 an run global balancer cmd in shell?
Best Regards,
Raymond Liu
> -----Original Message-----
> From: Ted Yu [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 9:09 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Is there any way to balance one table?
>
> What version of HBase are you using ?
>
> 0.94 has per-table load balancing.
>
> Cheers
>
> On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> wrote:
>
> > Hi
> >
> > Is there any way to balance just one table? I found one of my table is
> > not balanced, while all the other table is balanced. So I want to fix
> > this table.
> >
> > Best Regards,
> > Raymond Liu
> >
> >
Any cmd in shell? Or I need to change balance threshold to 0 an run global balancer cmd in shell?
Best Regards,
Raymond Liu
> -----Original Message-----
> From: Ted Yu [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 9:09 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Is there any way to balance one table?
>
> What version of HBase are you using ?
>
> 0.94 has per-table load balancing.
>
> Cheers
>
> On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> wrote:
>
> > Hi
> >
> > Is there any way to balance just one table? I found one of my table is
> > not balanced, while all the other table is balanced. So I want to fix
> > this table.
> >
> > Best Regards,
> > Raymond Liu
> >
> >
-
RE: Is there any way to balance one table?Liu, Raymond 2013-02-20, 02:35
I choose to move region manually. Any other approaching?
>
> 0.94.1
>
> Any cmd in shell? Or I need to change balance threshold to 0 an run global
> balancer cmd in shell?
>
>
>
> Best Regards,
> Raymond Liu
>
> > -----Original Message-----
> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 9:09 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > What version of HBase are you using ?
> >
> > 0.94 has per-table load balancing.
> >
> > Cheers
> >
> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Hi
> > >
> > > Is there any way to balance just one table? I found one of my table
> > > is not balanced, while all the other table is balanced. So I want to
> > > fix this table.
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > >
>
> 0.94.1
>
> Any cmd in shell? Or I need to change balance threshold to 0 an run global
> balancer cmd in shell?
>
>
>
> Best Regards,
> Raymond Liu
>
> > -----Original Message-----
> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 9:09 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > What version of HBase are you using ?
> >
> > 0.94 has per-table load balancing.
> >
> > Cheers
> >
> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Hi
> > >
> > > Is there any way to balance just one table? I found one of my table
> > > is not balanced, while all the other table is balanced. So I want to
> > > fix this table.
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > >
-
Re: Is there any way to balance one table?Jean-Marc Spaggiari 2013-02-20, 02:58
Hi Liu,
Why did not you simply called the balancer? If other tables are
already balanced, it should not touch them and will only balance the
table which is not balancer?
JM
2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> I choose to move region manually. Any other approaching?
>
>>
>> 0.94.1
>>
>> Any cmd in shell? Or I need to change balance threshold to 0 an run
>> global
>> balancer cmd in shell?
>>
>>
>>
>> Best Regards,
>> Raymond Liu
>>
>> > -----Original Message-----
>> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
>> > Sent: Wednesday, February 20, 2013 9:09 AM
>> > To: [EMAIL PROTECTED]
>> > Subject: Re: Is there any way to balance one table?
>> >
>> > What version of HBase are you using ?
>> >
>> > 0.94 has per-table load balancing.
>> >
>> > Cheers
>> >
>> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> > > Hi
>> > >
>> > > Is there any way to balance just one table? I found one of my table
>> > > is not balanced, while all the other table is balanced. So I want to
>> > > fix this table.
>> > >
>> > > Best Regards,
>> > > Raymond Liu
>> > >
>> > >
>
Why did not you simply called the balancer? If other tables are
already balanced, it should not touch them and will only balance the
table which is not balancer?
JM
2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> I choose to move region manually. Any other approaching?
>
>>
>> 0.94.1
>>
>> Any cmd in shell? Or I need to change balance threshold to 0 an run
>> global
>> balancer cmd in shell?
>>
>>
>>
>> Best Regards,
>> Raymond Liu
>>
>> > -----Original Message-----
>> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
>> > Sent: Wednesday, February 20, 2013 9:09 AM
>> > To: [EMAIL PROTECTED]
>> > Subject: Re: Is there any way to balance one table?
>> >
>> > What version of HBase are you using ?
>> >
>> > 0.94 has per-table load balancing.
>> >
>> > Cheers
>> >
>> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> > > Hi
>> > >
>> > > Is there any way to balance just one table? I found one of my table
>> > > is not balanced, while all the other table is balanced. So I want to
>> > > fix this table.
>> > >
>> > > Best Regards,
>> > > Raymond Liu
>> > >
>> > >
>
-
Re: Is there any way to balance one table?Ted Yu 2013-02-20, 03:23
HBASE-3373 introduced "hbase.master.loadbalance.bytable" which defaults to
true.
This means when you issue 'balancer' command in shell, table should be
balanced for you.
Cheers
On Tue, Feb 19, 2013 at 5:16 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> 0.94.1
>
> Any cmd in shell? Or I need to change balance threshold to 0 an run global
> balancer cmd in shell?
>
>
>
> Best Regards,
> Raymond Liu
>
> > -----Original Message-----
> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 9:09 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > What version of HBase are you using ?
> >
> > 0.94 has per-table load balancing.
> >
> > Cheers
> >
> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Hi
> > >
> > > Is there any way to balance just one table? I found one of my table is
> > > not balanced, while all the other table is balanced. So I want to fix
> > > this table.
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > >
>
true.
This means when you issue 'balancer' command in shell, table should be
balanced for you.
Cheers
On Tue, Feb 19, 2013 at 5:16 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> 0.94.1
>
> Any cmd in shell? Or I need to change balance threshold to 0 an run global
> balancer cmd in shell?
>
>
>
> Best Regards,
> Raymond Liu
>
> > -----Original Message-----
> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 9:09 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > What version of HBase are you using ?
> >
> > 0.94 has per-table load balancing.
> >
> > Cheers
> >
> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Hi
> > >
> > > Is there any way to balance just one table? I found one of my table is
> > > not balanced, while all the other table is balanced. So I want to fix
> > > this table.
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > >
>
-
RE: Is there any way to balance one table?Liu, Raymond 2013-02-20, 03:40
Hi
I do call balancer, while it seems it doesn't work. Might due to this table is small and overall region number difference is within threshold?
> -----Original Message-----
> From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 10:59 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Is there any way to balance one table?
>
> Hi Liu,
>
> Why did not you simply called the balancer? If other tables are already
> balanced, it should not touch them and will only balance the table which is not
> balancer?
>
> JM
>
> 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > I choose to move region manually. Any other approaching?
> >
> >>
> >> 0.94.1
> >>
> >> Any cmd in shell? Or I need to change balance threshold to 0 an run
> >> global balancer cmd in shell?
> >>
> >>
> >>
> >> Best Regards,
> >> Raymond Liu
> >>
> >> > -----Original Message-----
> >> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> >> > Sent: Wednesday, February 20, 2013 9:09 AM
> >> > To: [EMAIL PROTECTED]
> >> > Subject: Re: Is there any way to balance one table?
> >> >
> >> > What version of HBase are you using ?
> >> >
> >> > 0.94 has per-table load balancing.
> >> >
> >> > Cheers
> >> >
> >> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> >> > <[EMAIL PROTECTED]>
> >> > wrote:
> >> >
> >> > > Hi
> >> > >
> >> > > Is there any way to balance just one table? I found one of my
> >> > > table is not balanced, while all the other table is balanced. So
> >> > > I want to fix this table.
> >> > >
> >> > > Best Regards,
> >> > > Raymond Liu
> >> > >
> >> > >
> >
I do call balancer, while it seems it doesn't work. Might due to this table is small and overall region number difference is within threshold?
> -----Original Message-----
> From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 10:59 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Is there any way to balance one table?
>
> Hi Liu,
>
> Why did not you simply called the balancer? If other tables are already
> balanced, it should not touch them and will only balance the table which is not
> balancer?
>
> JM
>
> 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > I choose to move region manually. Any other approaching?
> >
> >>
> >> 0.94.1
> >>
> >> Any cmd in shell? Or I need to change balance threshold to 0 an run
> >> global balancer cmd in shell?
> >>
> >>
> >>
> >> Best Regards,
> >> Raymond Liu
> >>
> >> > -----Original Message-----
> >> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> >> > Sent: Wednesday, February 20, 2013 9:09 AM
> >> > To: [EMAIL PROTECTED]
> >> > Subject: Re: Is there any way to balance one table?
> >> >
> >> > What version of HBase are you using ?
> >> >
> >> > 0.94 has per-table load balancing.
> >> >
> >> > Cheers
> >> >
> >> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> >> > <[EMAIL PROTECTED]>
> >> > wrote:
> >> >
> >> > > Hi
> >> > >
> >> > > Is there any way to balance just one table? I found one of my
> >> > > table is not balanced, while all the other table is balanced. So
> >> > > I want to fix this table.
> >> > >
> >> > > Best Regards,
> >> > > Raymond Liu
> >> > >
> >> > >
> >
-
Re: Is there any way to balance one table?Marcos Ortiz 2013-02-20, 03:43
What is the size of your table?
On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> Hi
>
> I do call balancer, while it seems it doesn't work. Might due to this table is small and overall region number difference is within threshold?
>
>> -----Original Message-----
>> From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
>> Sent: Wednesday, February 20, 2013 10:59 AM
>> To: [EMAIL PROTECTED]
>> Subject: Re: Is there any way to balance one table?
>>
>> Hi Liu,
>>
>> Why did not you simply called the balancer? If other tables are already
>> balanced, it should not touch them and will only balance the table which is not
>> balancer?
>>
>> JM
>>
>> 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
>>> I choose to move region manually. Any other approaching?
>>>
>>>> 0.94.1
>>>>
>>>> Any cmd in shell? Or I need to change balance threshold to 0 an run
>>>> global balancer cmd in shell?
>>>>
>>>>
>>>>
>>>> Best Regards,
>>>> Raymond Liu
>>>>
>>>>> -----Original Message-----
>>>>> From: Ted Yu [mailto:[EMAIL PROTECTED]]
>>>>> Sent: Wednesday, February 20, 2013 9:09 AM
>>>>> To: [EMAIL PROTECTED]
>>>>> Subject: Re: Is there any way to balance one table?
>>>>>
>>>>> What version of HBase are you using ?
>>>>>
>>>>> 0.94 has per-table load balancing.
>>>>>
>>>>> Cheers
>>>>>
>>>>> On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
>>>>> <[EMAIL PROTECTED]>
>>>>> wrote:
>>>>>
>>>>>> Hi
>>>>>>
>>>>>> Is there any way to balance just one table? I found one of my
>>>>>> table is not balanced, while all the other table is balanced. So
>>>>>> I want to fix this table.
>>>>>>
>>>>>> Best Regards,
>>>>>> Raymond Liu
>>>>>>
>>>>>>
--
Marcos Ortiz Valmaseda,
Product Manager && Data Scientist at UCI
Blog: http://marcosluis2186.posterous.com
Twitter: @marcosluis2186 <http://twitter.com/marcosluis2186>
On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> Hi
>
> I do call balancer, while it seems it doesn't work. Might due to this table is small and overall region number difference is within threshold?
>
>> -----Original Message-----
>> From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
>> Sent: Wednesday, February 20, 2013 10:59 AM
>> To: [EMAIL PROTECTED]
>> Subject: Re: Is there any way to balance one table?
>>
>> Hi Liu,
>>
>> Why did not you simply called the balancer? If other tables are already
>> balanced, it should not touch them and will only balance the table which is not
>> balancer?
>>
>> JM
>>
>> 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
>>> I choose to move region manually. Any other approaching?
>>>
>>>> 0.94.1
>>>>
>>>> Any cmd in shell? Or I need to change balance threshold to 0 an run
>>>> global balancer cmd in shell?
>>>>
>>>>
>>>>
>>>> Best Regards,
>>>> Raymond Liu
>>>>
>>>>> -----Original Message-----
>>>>> From: Ted Yu [mailto:[EMAIL PROTECTED]]
>>>>> Sent: Wednesday, February 20, 2013 9:09 AM
>>>>> To: [EMAIL PROTECTED]
>>>>> Subject: Re: Is there any way to balance one table?
>>>>>
>>>>> What version of HBase are you using ?
>>>>>
>>>>> 0.94 has per-table load balancing.
>>>>>
>>>>> Cheers
>>>>>
>>>>> On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
>>>>> <[EMAIL PROTECTED]>
>>>>> wrote:
>>>>>
>>>>>> Hi
>>>>>>
>>>>>> Is there any way to balance just one table? I found one of my
>>>>>> table is not balanced, while all the other table is balanced. So
>>>>>> I want to fix this table.
>>>>>>
>>>>>> Best Regards,
>>>>>> Raymond Liu
>>>>>>
>>>>>>
--
Marcos Ortiz Valmaseda,
Product Manager && Data Scientist at UCI
Blog: http://marcosluis2186.posterous.com
Twitter: @marcosluis2186 <http://twitter.com/marcosluis2186>
-
Re: Is there any way to balance one table?Ted Yu 2013-02-20, 03:45
You're right. Default sloppiness is 20%:
this.slop = conf.getFloat("hbase.regions.slop", (float) 0.2);
src/main/java/org/apache/hadoop/hbase/master/DefaultLoadBalancer.java
Meaning, region count on any server can be as far as 20% from average
region count.
You can tighten sloppiness.
On Tue, Feb 19, 2013 at 7:40 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> Hi
>
> I do call balancer, while it seems it doesn't work. Might due to this
> table is small and overall region number difference is within threshold?
>
> > -----Original Message-----
> > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 10:59 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > Hi Liu,
> >
> > Why did not you simply called the balancer? If other tables are already
> > balanced, it should not touch them and will only balance the table which
> is not
> > balancer?
> >
> > JM
> >
> > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > > I choose to move region manually. Any other approaching?
> > >
> > >>
> > >> 0.94.1
> > >>
> > >> Any cmd in shell? Or I need to change balance threshold to 0 an run
> > >> global balancer cmd in shell?
> > >>
> > >>
> > >>
> > >> Best Regards,
> > >> Raymond Liu
> > >>
> > >> > -----Original Message-----
> > >> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > >> > Sent: Wednesday, February 20, 2013 9:09 AM
> > >> > To: [EMAIL PROTECTED]
> > >> > Subject: Re: Is there any way to balance one table?
> > >> >
> > >> > What version of HBase are you using ?
> > >> >
> > >> > 0.94 has per-table load balancing.
> > >> >
> > >> > Cheers
> > >> >
> > >> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> > >> > <[EMAIL PROTECTED]>
> > >> > wrote:
> > >> >
> > >> > > Hi
> > >> > >
> > >> > > Is there any way to balance just one table? I found one of my
> > >> > > table is not balanced, while all the other table is balanced. So
> > >> > > I want to fix this table.
> > >> > >
> > >> > > Best Regards,
> > >> > > Raymond Liu
> > >> > >
> > >> > >
> > >
>
this.slop = conf.getFloat("hbase.regions.slop", (float) 0.2);
src/main/java/org/apache/hadoop/hbase/master/DefaultLoadBalancer.java
Meaning, region count on any server can be as far as 20% from average
region count.
You can tighten sloppiness.
On Tue, Feb 19, 2013 at 7:40 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> Hi
>
> I do call balancer, while it seems it doesn't work. Might due to this
> table is small and overall region number difference is within threshold?
>
> > -----Original Message-----
> > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 10:59 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > Hi Liu,
> >
> > Why did not you simply called the balancer? If other tables are already
> > balanced, it should not touch them and will only balance the table which
> is not
> > balancer?
> >
> > JM
> >
> > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > > I choose to move region manually. Any other approaching?
> > >
> > >>
> > >> 0.94.1
> > >>
> > >> Any cmd in shell? Or I need to change balance threshold to 0 an run
> > >> global balancer cmd in shell?
> > >>
> > >>
> > >>
> > >> Best Regards,
> > >> Raymond Liu
> > >>
> > >> > -----Original Message-----
> > >> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > >> > Sent: Wednesday, February 20, 2013 9:09 AM
> > >> > To: [EMAIL PROTECTED]
> > >> > Subject: Re: Is there any way to balance one table?
> > >> >
> > >> > What version of HBase are you using ?
> > >> >
> > >> > 0.94 has per-table load balancing.
> > >> >
> > >> > Cheers
> > >> >
> > >> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> > >> > <[EMAIL PROTECTED]>
> > >> > wrote:
> > >> >
> > >> > > Hi
> > >> > >
> > >> > > Is there any way to balance just one table? I found one of my
> > >> > > table is not balanced, while all the other table is balanced. So
> > >> > > I want to fix this table.
> > >> > >
> > >> > > Best Regards,
> > >> > > Raymond Liu
> > >> > >
> > >> > >
> > >
>
-
RE: Is there any way to balance one table?Liu, Raymond 2013-02-20, 03:48
I mean region number is small.
Overall I have say 3000 region on 4 node, while this table only have 96 region. It won't be 24 for each region server, instead , will be something like 19/30/23/21 etc.
This means that I need to limit the slop to 0.02 etc? so that the balancer actually run on this table?
Best Regards,
Raymond Liu
From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, February 20, 2013 11:44 AM
To: [EMAIL PROTECTED]
Cc: Liu, Raymond
Subject: Re: Is there any way to balance one table?
What is the size of your table?
On 02/19/2013 10:40 PM, Liu, Raymond wrote:
Hi
I do call balancer, while it seems it doesn't work. Might due to this table is small and overall region number difference is within threshold?
-----Original Message-----
From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, February 20, 2013 10:59 AM
To: [EMAIL PROTECTED]
Subject: Re: Is there any way to balance one table?
Hi Liu,
Why did not you simply called the balancer? If other tables are already
balanced, it should not touch them and will only balance the table which is not
balancer?
JM
2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
I choose to move region manually. Any other approaching?
0.94.1
Any cmd in shell? Or I need to change balance threshold to 0 an run
global balancer cmd in shell?
Best Regards,
Raymond Liu
-----Original Message-----
From: Ted Yu [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, February 20, 2013 9:09 AM
To: [EMAIL PROTECTED]
Subject: Re: Is there any way to balance one table?
What version of HBase are you using ?
0.94 has per-table load balancing.
Cheers
On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
<[EMAIL PROTECTED]>
wrote:
Hi
Is there any way to balance just one table? I found one of my
table is not balanced, while all the other table is balanced. So
I want to fix this table.
Best Regards,
Raymond Liu
--
Marcos Ortiz Valmaseda,
Product Manager && Data Scientist at UCI
Blog: http://marcosluis2186.posterous.com
Twitter: @marcosluis2186
Overall I have say 3000 region on 4 node, while this table only have 96 region. It won't be 24 for each region server, instead , will be something like 19/30/23/21 etc.
This means that I need to limit the slop to 0.02 etc? so that the balancer actually run on this table?
Best Regards,
Raymond Liu
From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, February 20, 2013 11:44 AM
To: [EMAIL PROTECTED]
Cc: Liu, Raymond
Subject: Re: Is there any way to balance one table?
What is the size of your table?
On 02/19/2013 10:40 PM, Liu, Raymond wrote:
Hi
I do call balancer, while it seems it doesn't work. Might due to this table is small and overall region number difference is within threshold?
-----Original Message-----
From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, February 20, 2013 10:59 AM
To: [EMAIL PROTECTED]
Subject: Re: Is there any way to balance one table?
Hi Liu,
Why did not you simply called the balancer? If other tables are already
balanced, it should not touch them and will only balance the table which is not
balancer?
JM
2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
I choose to move region manually. Any other approaching?
0.94.1
Any cmd in shell? Or I need to change balance threshold to 0 an run
global balancer cmd in shell?
Best Regards,
Raymond Liu
-----Original Message-----
From: Ted Yu [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, February 20, 2013 9:09 AM
To: [EMAIL PROTECTED]
Subject: Re: Is there any way to balance one table?
What version of HBase are you using ?
0.94 has per-table load balancing.
Cheers
On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
<[EMAIL PROTECTED]>
wrote:
Hi
Is there any way to balance just one table? I found one of my
table is not balanced, while all the other table is balanced. So
I want to fix this table.
Best Regards,
Raymond Liu
--
Marcos Ortiz Valmaseda,
Product Manager && Data Scientist at UCI
Blog: http://marcosluis2186.posterous.com
Twitter: @marcosluis2186
-
RE: Is there any way to balance one table?Liu, Raymond 2013-02-20, 03:49
Yeah, Since balance is already done on each table, why slop is not calculate upon each table...
>
> You're right. Default sloppiness is 20%:
> this.slop = conf.getFloat("hbase.regions.slop", (float) 0.2);
> src/main/java/org/apache/hadoop/hbase/master/DefaultLoadBalancer.java
>
> Meaning, region count on any server can be as far as 20% from average region
> count.
>
> You can tighten sloppiness.
>
> On Tue, Feb 19, 2013 at 7:40 PM, Liu, Raymond <[EMAIL PROTECTED]>
> wrote:
>
> > Hi
> >
> > I do call balancer, while it seems it doesn't work. Might due to this
> > table is small and overall region number difference is within threshold?
> >
> > > -----Original Message-----
> > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > > Sent: Wednesday, February 20, 2013 10:59 AM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: Is there any way to balance one table?
> > >
> > > Hi Liu,
> > >
> > > Why did not you simply called the balancer? If other tables are
> > > already balanced, it should not touch them and will only balance the
> > > table which
> > is not
> > > balancer?
> > >
> > > JM
> > >
> > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > > > I choose to move region manually. Any other approaching?
> > > >
> > > >>
> > > >> 0.94.1
> > > >>
> > > >> Any cmd in shell? Or I need to change balance threshold to 0 an
> > > >> run global balancer cmd in shell?
> > > >>
> > > >>
> > > >>
> > > >> Best Regards,
> > > >> Raymond Liu
> > > >>
> > > >> > -----Original Message-----
> > > >> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > > >> > Sent: Wednesday, February 20, 2013 9:09 AM
> > > >> > To: [EMAIL PROTECTED]
> > > >> > Subject: Re: Is there any way to balance one table?
> > > >> >
> > > >> > What version of HBase are you using ?
> > > >> >
> > > >> > 0.94 has per-table load balancing.
> > > >> >
> > > >> > Cheers
> > > >> >
> > > >> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> > > >> > <[EMAIL PROTECTED]>
> > > >> > wrote:
> > > >> >
> > > >> > > Hi
> > > >> > >
> > > >> > > Is there any way to balance just one table? I found one of my
> > > >> > > table is not balanced, while all the other table is balanced.
> > > >> > > So I want to fix this table.
> > > >> > >
> > > >> > > Best Regards,
> > > >> > > Raymond Liu
> > > >> > >
> > > >> > >
> > > >
> >
>
> You're right. Default sloppiness is 20%:
> this.slop = conf.getFloat("hbase.regions.slop", (float) 0.2);
> src/main/java/org/apache/hadoop/hbase/master/DefaultLoadBalancer.java
>
> Meaning, region count on any server can be as far as 20% from average region
> count.
>
> You can tighten sloppiness.
>
> On Tue, Feb 19, 2013 at 7:40 PM, Liu, Raymond <[EMAIL PROTECTED]>
> wrote:
>
> > Hi
> >
> > I do call balancer, while it seems it doesn't work. Might due to this
> > table is small and overall region number difference is within threshold?
> >
> > > -----Original Message-----
> > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > > Sent: Wednesday, February 20, 2013 10:59 AM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: Is there any way to balance one table?
> > >
> > > Hi Liu,
> > >
> > > Why did not you simply called the balancer? If other tables are
> > > already balanced, it should not touch them and will only balance the
> > > table which
> > is not
> > > balancer?
> > >
> > > JM
> > >
> > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > > > I choose to move region manually. Any other approaching?
> > > >
> > > >>
> > > >> 0.94.1
> > > >>
> > > >> Any cmd in shell? Or I need to change balance threshold to 0 an
> > > >> run global balancer cmd in shell?
> > > >>
> > > >>
> > > >>
> > > >> Best Regards,
> > > >> Raymond Liu
> > > >>
> > > >> > -----Original Message-----
> > > >> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > > >> > Sent: Wednesday, February 20, 2013 9:09 AM
> > > >> > To: [EMAIL PROTECTED]
> > > >> > Subject: Re: Is there any way to balance one table?
> > > >> >
> > > >> > What version of HBase are you using ?
> > > >> >
> > > >> > 0.94 has per-table load balancing.
> > > >> >
> > > >> > Cheers
> > > >> >
> > > >> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> > > >> > <[EMAIL PROTECTED]>
> > > >> > wrote:
> > > >> >
> > > >> > > Hi
> > > >> > >
> > > >> > > Is there any way to balance just one table? I found one of my
> > > >> > > table is not balanced, while all the other table is balanced.
> > > >> > > So I want to fix this table.
> > > >> > >
> > > >> > > Best Regards,
> > > >> > > Raymond Liu
> > > >> > >
> > > >> > >
> > > >
> >
-
Re: Is there any way to balance one table?Ted Yu 2013-02-20, 03:51
Yes, Raymond.
You should lower sloppiness.
On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> I mean region number is small.
>
> Overall I have say 3000 region on 4 node, while this table only have 96
> region. It won't be 24 for each region server, instead , will be something
> like 19/30/23/21 etc.
>
> This means that I need to limit the slop to 0.02 etc? so that the balancer
> actually run on this table?
>
> Best Regards,
> Raymond Liu
>
> From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 11:44 AM
> To: [EMAIL PROTECTED]
> Cc: Liu, Raymond
> Subject: Re: Is there any way to balance one table?
>
> What is the size of your table?
> On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> Hi
>
> I do call balancer, while it seems it doesn't work. Might due to this
> table is small and overall region number difference is within threshold?
>
> -----Original Message-----
> From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 10:59 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Is there any way to balance one table?
>
> Hi Liu,
>
> Why did not you simply called the balancer? If other tables are already
> balanced, it should not touch them and will only balance the table which
> is not
> balancer?
>
> JM
>
> 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> I choose to move region manually. Any other approaching?
>
>
> 0.94.1
>
> Any cmd in shell? Or I need to change balance threshold to 0 an run
> global balancer cmd in shell?
>
>
>
> Best Regards,
> Raymond Liu
>
> -----Original Message-----
> From: Ted Yu [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 9:09 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Is there any way to balance one table?
>
> What version of HBase are you using ?
>
> 0.94 has per-table load balancing.
>
> Cheers
>
> On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> <[EMAIL PROTECTED]>
> wrote:
>
> Hi
>
> Is there any way to balance just one table? I found one of my
> table is not balanced, while all the other table is balanced. So
> I want to fix this table.
>
> Best Regards,
> Raymond Liu
>
>
>
>
> --
> Marcos Ortiz Valmaseda,
> Product Manager && Data Scientist at UCI
> Blog: http://marcosluis2186.posterous.com
> Twitter: @marcosluis2186
>
You should lower sloppiness.
On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> I mean region number is small.
>
> Overall I have say 3000 region on 4 node, while this table only have 96
> region. It won't be 24 for each region server, instead , will be something
> like 19/30/23/21 etc.
>
> This means that I need to limit the slop to 0.02 etc? so that the balancer
> actually run on this table?
>
> Best Regards,
> Raymond Liu
>
> From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 11:44 AM
> To: [EMAIL PROTECTED]
> Cc: Liu, Raymond
> Subject: Re: Is there any way to balance one table?
>
> What is the size of your table?
> On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> Hi
>
> I do call balancer, while it seems it doesn't work. Might due to this
> table is small and overall region number difference is within threshold?
>
> -----Original Message-----
> From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 10:59 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Is there any way to balance one table?
>
> Hi Liu,
>
> Why did not you simply called the balancer? If other tables are already
> balanced, it should not touch them and will only balance the table which
> is not
> balancer?
>
> JM
>
> 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> I choose to move region manually. Any other approaching?
>
>
> 0.94.1
>
> Any cmd in shell? Or I need to change balance threshold to 0 an run
> global balancer cmd in shell?
>
>
>
> Best Regards,
> Raymond Liu
>
> -----Original Message-----
> From: Ted Yu [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 20, 2013 9:09 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Is there any way to balance one table?
>
> What version of HBase are you using ?
>
> 0.94 has per-table load balancing.
>
> Cheers
>
> On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> <[EMAIL PROTECTED]>
> wrote:
>
> Hi
>
> Is there any way to balance just one table? I found one of my
> table is not balanced, while all the other table is balanced. So
> I want to fix this table.
>
> Best Regards,
> Raymond Liu
>
>
>
>
> --
> Marcos Ortiz Valmaseda,
> Product Manager && Data Scientist at UCI
> Blog: http://marcosluis2186.posterous.com
> Twitter: @marcosluis2186
>
-
RE: Is there any way to balance one table?Liu, Raymond 2013-02-20, 03:55
Hmm, in order to have the 96 region table be balanced within 20% On a 3000 region cluster when all other table is balanced.
the slop will need to be around 20%/30, say 0.006? won't it be too small?
>
> Yes, Raymond.
> You should lower sloppiness.
>
> On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond <[EMAIL PROTECTED]>
> wrote:
>
> > I mean region number is small.
> >
> > Overall I have say 3000 region on 4 node, while this table only have
> > 96 region. It won't be 24 for each region server, instead , will be
> > something like 19/30/23/21 etc.
> >
> > This means that I need to limit the slop to 0.02 etc? so that the
> > balancer actually run on this table?
> >
> > Best Regards,
> > Raymond Liu
> >
> > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 11:44 AM
> > To: [EMAIL PROTECTED]
> > Cc: Liu, Raymond
> > Subject: Re: Is there any way to balance one table?
> >
> > What is the size of your table?
> > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> > Hi
> >
> > I do call balancer, while it seems it doesn't work. Might due to this
> > table is small and overall region number difference is within threshold?
> >
> > -----Original Message-----
> > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 10:59 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > Hi Liu,
> >
> > Why did not you simply called the balancer? If other tables are
> > already balanced, it should not touch them and will only balance the
> > table which is not balancer?
> >
> > JM
> >
> > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > I choose to move region manually. Any other approaching?
> >
> >
> > 0.94.1
> >
> > Any cmd in shell? Or I need to change balance threshold to 0 an run
> > global balancer cmd in shell?
> >
> >
> >
> > Best Regards,
> > Raymond Liu
> >
> > -----Original Message-----
> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 9:09 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > What version of HBase are you using ?
> >
> > 0.94 has per-table load balancing.
> >
> > Cheers
> >
> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > wrote:
> >
> > Hi
> >
> > Is there any way to balance just one table? I found one of my table is
> > not balanced, while all the other table is balanced. So I want to fix
> > this table.
> >
> > Best Regards,
> > Raymond Liu
> >
> >
> >
> >
> > --
> > Marcos Ortiz Valmaseda,
> > Product Manager && Data Scientist at UCI
> > Blog: http://marcosluis2186.posterous.com
> > Twitter: @marcosluis2186
> >
the slop will need to be around 20%/30, say 0.006? won't it be too small?
>
> Yes, Raymond.
> You should lower sloppiness.
>
> On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond <[EMAIL PROTECTED]>
> wrote:
>
> > I mean region number is small.
> >
> > Overall I have say 3000 region on 4 node, while this table only have
> > 96 region. It won't be 24 for each region server, instead , will be
> > something like 19/30/23/21 etc.
> >
> > This means that I need to limit the slop to 0.02 etc? so that the
> > balancer actually run on this table?
> >
> > Best Regards,
> > Raymond Liu
> >
> > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 11:44 AM
> > To: [EMAIL PROTECTED]
> > Cc: Liu, Raymond
> > Subject: Re: Is there any way to balance one table?
> >
> > What is the size of your table?
> > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> > Hi
> >
> > I do call balancer, while it seems it doesn't work. Might due to this
> > table is small and overall region number difference is within threshold?
> >
> > -----Original Message-----
> > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 10:59 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > Hi Liu,
> >
> > Why did not you simply called the balancer? If other tables are
> > already balanced, it should not touch them and will only balance the
> > table which is not balancer?
> >
> > JM
> >
> > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > I choose to move region manually. Any other approaching?
> >
> >
> > 0.94.1
> >
> > Any cmd in shell? Or I need to change balance threshold to 0 an run
> > global balancer cmd in shell?
> >
> >
> >
> > Best Regards,
> > Raymond Liu
> >
> > -----Original Message-----
> > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, February 20, 2013 9:09 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Is there any way to balance one table?
> >
> > What version of HBase are you using ?
> >
> > 0.94 has per-table load balancing.
> >
> > Cheers
> >
> > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > wrote:
> >
> > Hi
> >
> > Is there any way to balance just one table? I found one of my table is
> > not balanced, while all the other table is balanced. So I want to fix
> > this table.
> >
> > Best Regards,
> > Raymond Liu
> >
> >
> >
> >
> > --
> > Marcos Ortiz Valmaseda,
> > Product Manager && Data Scientist at UCI
> > Blog: http://marcosluis2186.posterous.com
> > Twitter: @marcosluis2186
> >
-
Re: Is there any way to balance one table?Ted Yu 2013-02-20, 04:31
bq. On a 3000 region cluster
Balancing is per-table. Meaning total number of regions doesn't come into
play.
On Tue, Feb 19, 2013 at 7:55 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> Hmm, in order to have the 96 region table be balanced within 20% On a 3000
> region cluster when all other table is balanced.
>
> the slop will need to be around 20%/30, say 0.006? won't it be too small?
>
> >
> > Yes, Raymond.
> > You should lower sloppiness.
> >
> > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > wrote:
> >
> > > I mean region number is small.
> > >
> > > Overall I have say 3000 region on 4 node, while this table only have
> > > 96 region. It won't be 24 for each region server, instead , will be
> > > something like 19/30/23/21 etc.
> > >
> > > This means that I need to limit the slop to 0.02 etc? so that the
> > > balancer actually run on this table?
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> > > Sent: Wednesday, February 20, 2013 11:44 AM
> > > To: [EMAIL PROTECTED]
> > > Cc: Liu, Raymond
> > > Subject: Re: Is there any way to balance one table?
> > >
> > > What is the size of your table?
> > > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> > > Hi
> > >
> > > I do call balancer, while it seems it doesn't work. Might due to this
> > > table is small and overall region number difference is within
> threshold?
> > >
> > > -----Original Message-----
> > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > > Sent: Wednesday, February 20, 2013 10:59 AM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: Is there any way to balance one table?
> > >
> > > Hi Liu,
> > >
> > > Why did not you simply called the balancer? If other tables are
> > > already balanced, it should not touch them and will only balance the
> > > table which is not balancer?
> > >
> > > JM
> > >
> > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > > I choose to move region manually. Any other approaching?
> > >
> > >
> > > 0.94.1
> > >
> > > Any cmd in shell? Or I need to change balance threshold to 0 an run
> > > global balancer cmd in shell?
> > >
> > >
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > > -----Original Message-----
> > > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > > Sent: Wednesday, February 20, 2013 9:09 AM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: Is there any way to balance one table?
> > >
> > > What version of HBase are you using ?
> > >
> > > 0.94 has per-table load balancing.
> > >
> > > Cheers
> > >
> > > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > > wrote:
> > >
> > > Hi
> > >
> > > Is there any way to balance just one table? I found one of my table is
> > > not balanced, while all the other table is balanced. So I want to fix
> > > this table.
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > >
> > >
> > >
> > > --
> > > Marcos Ortiz Valmaseda,
> > > Product Manager && Data Scientist at UCI
> > > Blog: http://marcosluis2186.posterous.com
> > > Twitter: @marcosluis2186
> > >
>
Balancing is per-table. Meaning total number of regions doesn't come into
play.
On Tue, Feb 19, 2013 at 7:55 PM, Liu, Raymond <[EMAIL PROTECTED]> wrote:
> Hmm, in order to have the 96 region table be balanced within 20% On a 3000
> region cluster when all other table is balanced.
>
> the slop will need to be around 20%/30, say 0.006? won't it be too small?
>
> >
> > Yes, Raymond.
> > You should lower sloppiness.
> >
> > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > wrote:
> >
> > > I mean region number is small.
> > >
> > > Overall I have say 3000 region on 4 node, while this table only have
> > > 96 region. It won't be 24 for each region server, instead , will be
> > > something like 19/30/23/21 etc.
> > >
> > > This means that I need to limit the slop to 0.02 etc? so that the
> > > balancer actually run on this table?
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> > > Sent: Wednesday, February 20, 2013 11:44 AM
> > > To: [EMAIL PROTECTED]
> > > Cc: Liu, Raymond
> > > Subject: Re: Is there any way to balance one table?
> > >
> > > What is the size of your table?
> > > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> > > Hi
> > >
> > > I do call balancer, while it seems it doesn't work. Might due to this
> > > table is small and overall region number difference is within
> threshold?
> > >
> > > -----Original Message-----
> > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > > Sent: Wednesday, February 20, 2013 10:59 AM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: Is there any way to balance one table?
> > >
> > > Hi Liu,
> > >
> > > Why did not you simply called the balancer? If other tables are
> > > already balanced, it should not touch them and will only balance the
> > > table which is not balancer?
> > >
> > > JM
> > >
> > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > > I choose to move region manually. Any other approaching?
> > >
> > >
> > > 0.94.1
> > >
> > > Any cmd in shell? Or I need to change balance threshold to 0 an run
> > > global balancer cmd in shell?
> > >
> > >
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > > -----Original Message-----
> > > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > > Sent: Wednesday, February 20, 2013 9:09 AM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: Is there any way to balance one table?
> > >
> > > What version of HBase are you using ?
> > >
> > > 0.94 has per-table load balancing.
> > >
> > > Cheers
> > >
> > > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond <[EMAIL PROTECTED]>
> > > wrote:
> > >
> > > Hi
> > >
> > > Is there any way to balance just one table? I found one of my table is
> > > not balanced, while all the other table is balanced. So I want to fix
> > > this table.
> > >
> > > Best Regards,
> > > Raymond Liu
> > >
> > >
> > >
> > >
> > > --
> > > Marcos Ortiz Valmaseda,
> > > Product Manager && Data Scientist at UCI
> > > Blog: http://marcosluis2186.posterous.com
> > > Twitter: @marcosluis2186
> > >
>
-
RE: Is there any way to balance one table?Liu, Raymond 2013-02-20, 05:52
You mean slop is also base on per table?
Weird, then it should work for my case.... let me check again.
Best Regards,
Raymond Liu
>
> bq. On a 3000 region cluster
>
> Balancing is per-table. Meaning total number of regions doesn't come into play.
>
> On Tue, Feb 19, 2013 at 7:55 PM, Liu, Raymond <[EMAIL PROTECTED]>
> wrote:
>
> > Hmm, in order to have the 96 region table be balanced within 20% On a
> > 3000 region cluster when all other table is balanced.
> >
> > the slop will need to be around 20%/30, say 0.006? won't it be too small?
> >
> > >
> > > Yes, Raymond.
> > > You should lower sloppiness.
> > >
> > > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond
> > > <[EMAIL PROTECTED]>
> > > wrote:
> > >
> > > > I mean region number is small.
> > > >
> > > > Overall I have say 3000 region on 4 node, while this table only
> > > > have
> > > > 96 region. It won't be 24 for each region server, instead , will
> > > > be something like 19/30/23/21 etc.
> > > >
> > > > This means that I need to limit the slop to 0.02 etc? so that the
> > > > balancer actually run on this table?
> > > >
> > > > Best Regards,
> > > > Raymond Liu
> > > >
> > > > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> > > > Sent: Wednesday, February 20, 2013 11:44 AM
> > > > To: [EMAIL PROTECTED]
> > > > Cc: Liu, Raymond
> > > > Subject: Re: Is there any way to balance one table?
> > > >
> > > > What is the size of your table?
> > > > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> > > > Hi
> > > >
> > > > I do call balancer, while it seems it doesn't work. Might due to
> > > > this table is small and overall region number difference is within
> > threshold?
> > > >
> > > > -----Original Message-----
> > > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > > > Sent: Wednesday, February 20, 2013 10:59 AM
> > > > To: [EMAIL PROTECTED]
> > > > Subject: Re: Is there any way to balance one table?
> > > >
> > > > Hi Liu,
> > > >
> > > > Why did not you simply called the balancer? If other tables are
> > > > already balanced, it should not touch them and will only balance
> > > > the table which is not balancer?
> > > >
> > > > JM
> > > >
> > > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > > > I choose to move region manually. Any other approaching?
> > > >
> > > >
> > > > 0.94.1
> > > >
> > > > Any cmd in shell? Or I need to change balance threshold to 0 an
> > > > run global balancer cmd in shell?
> > > >
> > > >
> > > >
> > > > Best Regards,
> > > > Raymond Liu
> > > >
> > > > -----Original Message-----
> > > > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > > > Sent: Wednesday, February 20, 2013 9:09 AM
> > > > To: [EMAIL PROTECTED]
> > > > Subject: Re: Is there any way to balance one table?
> > > >
> > > > What version of HBase are you using ?
> > > >
> > > > 0.94 has per-table load balancing.
> > > >
> > > > Cheers
> > > >
> > > > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> > > > <[EMAIL PROTECTED]>
> > > > wrote:
> > > >
> > > > Hi
> > > >
> > > > Is there any way to balance just one table? I found one of my
> > > > table is not balanced, while all the other table is balanced. So I
> > > > want to fix this table.
> > > >
> > > > Best Regards,
> > > > Raymond Liu
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Marcos Ortiz Valmaseda,
> > > > Product Manager && Data Scientist at UCI
> > > > Blog: http://marcosluis2186.posterous.com
> > > > Twitter: @marcosluis2186
> > > >
> >
Weird, then it should work for my case.... let me check again.
Best Regards,
Raymond Liu
>
> bq. On a 3000 region cluster
>
> Balancing is per-table. Meaning total number of regions doesn't come into play.
>
> On Tue, Feb 19, 2013 at 7:55 PM, Liu, Raymond <[EMAIL PROTECTED]>
> wrote:
>
> > Hmm, in order to have the 96 region table be balanced within 20% On a
> > 3000 region cluster when all other table is balanced.
> >
> > the slop will need to be around 20%/30, say 0.006? won't it be too small?
> >
> > >
> > > Yes, Raymond.
> > > You should lower sloppiness.
> > >
> > > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond
> > > <[EMAIL PROTECTED]>
> > > wrote:
> > >
> > > > I mean region number is small.
> > > >
> > > > Overall I have say 3000 region on 4 node, while this table only
> > > > have
> > > > 96 region. It won't be 24 for each region server, instead , will
> > > > be something like 19/30/23/21 etc.
> > > >
> > > > This means that I need to limit the slop to 0.02 etc? so that the
> > > > balancer actually run on this table?
> > > >
> > > > Best Regards,
> > > > Raymond Liu
> > > >
> > > > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> > > > Sent: Wednesday, February 20, 2013 11:44 AM
> > > > To: [EMAIL PROTECTED]
> > > > Cc: Liu, Raymond
> > > > Subject: Re: Is there any way to balance one table?
> > > >
> > > > What is the size of your table?
> > > > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> > > > Hi
> > > >
> > > > I do call balancer, while it seems it doesn't work. Might due to
> > > > this table is small and overall region number difference is within
> > threshold?
> > > >
> > > > -----Original Message-----
> > > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> > > > Sent: Wednesday, February 20, 2013 10:59 AM
> > > > To: [EMAIL PROTECTED]
> > > > Subject: Re: Is there any way to balance one table?
> > > >
> > > > Hi Liu,
> > > >
> > > > Why did not you simply called the balancer? If other tables are
> > > > already balanced, it should not touch them and will only balance
> > > > the table which is not balancer?
> > > >
> > > > JM
> > > >
> > > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> > > > I choose to move region manually. Any other approaching?
> > > >
> > > >
> > > > 0.94.1
> > > >
> > > > Any cmd in shell? Or I need to change balance threshold to 0 an
> > > > run global balancer cmd in shell?
> > > >
> > > >
> > > >
> > > > Best Regards,
> > > > Raymond Liu
> > > >
> > > > -----Original Message-----
> > > > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> > > > Sent: Wednesday, February 20, 2013 9:09 AM
> > > > To: [EMAIL PROTECTED]
> > > > Subject: Re: Is there any way to balance one table?
> > > >
> > > > What version of HBase are you using ?
> > > >
> > > > 0.94 has per-table load balancing.
> > > >
> > > > Cheers
> > > >
> > > > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> > > > <[EMAIL PROTECTED]>
> > > > wrote:
> > > >
> > > > Hi
> > > >
> > > > Is there any way to balance just one table? I found one of my
> > > > table is not balanced, while all the other table is balanced. So I
> > > > want to fix this table.
> > > >
> > > > Best Regards,
> > > > Raymond Liu
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Marcos Ortiz Valmaseda,
> > > > Product Manager && Data Scientist at UCI
> > > > Blog: http://marcosluis2186.posterous.com
> > > > Twitter: @marcosluis2186
> > > >
> >
-
Re: Is there any way to balance one table?Jean-Marc Spaggiari 2013-02-20, 12:19
Hi Raymond,
Yes, tables are balanced on by one. Balancer is taking one table,
looking if it's already balancer or not, do the required move if any
is needed, and then move to the next table.
In your example, average is 23.25. 20% is 4.65. So everything between
18.6 and 27.9 should be ok. So balancer should remove some regions for
the 3rd server (19 i/30/23/21).
If you want to have that more evenly balanced, reduce the
hbase.regions.slop value to something lower, like 0.1 or even 0.05.
Don't go too low else it will never stop balancing the table each 5
minutes.
JM
2013/2/20, Liu, Raymond <[EMAIL PROTECTED]>:
> You mean slop is also base on per table?
> Weird, then it should work for my case.... let me check again.
>
> Best Regards,
> Raymond Liu
>
>>
>> bq. On a 3000 region cluster
>>
>> Balancing is per-table. Meaning total number of regions doesn't come into
>> play.
>>
>> On Tue, Feb 19, 2013 at 7:55 PM, Liu, Raymond <[EMAIL PROTECTED]>
>> wrote:
>>
>> > Hmm, in order to have the 96 region table be balanced within 20% On a
>> > 3000 region cluster when all other table is balanced.
>> >
>> > the slop will need to be around 20%/30, say 0.006? won't it be too
>> > small?
>> >
>> > >
>> > > Yes, Raymond.
>> > > You should lower sloppiness.
>> > >
>> > > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond
>> > > <[EMAIL PROTECTED]>
>> > > wrote:
>> > >
>> > > > I mean region number is small.
>> > > >
>> > > > Overall I have say 3000 region on 4 node, while this table only
>> > > > have
>> > > > 96 region. It won't be 24 for each region server, instead , will
>> > > > be something like 19/30/23/21 etc.
>> > > >
>> > > > This means that I need to limit the slop to 0.02 etc? so that the
>> > > > balancer actually run on this table?
>> > > >
>> > > > Best Regards,
>> > > > Raymond Liu
>> > > >
>> > > > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
>> > > > Sent: Wednesday, February 20, 2013 11:44 AM
>> > > > To: [EMAIL PROTECTED]
>> > > > Cc: Liu, Raymond
>> > > > Subject: Re: Is there any way to balance one table?
>> > > >
>> > > > What is the size of your table?
>> > > > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
>> > > > Hi
>> > > >
>> > > > I do call balancer, while it seems it doesn't work. Might due to
>> > > > this table is small and overall region number difference is within
>> > threshold?
>> > > >
>> > > > -----Original Message-----
>> > > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
>> > > > Sent: Wednesday, February 20, 2013 10:59 AM
>> > > > To: [EMAIL PROTECTED]
>> > > > Subject: Re: Is there any way to balance one table?
>> > > >
>> > > > Hi Liu,
>> > > >
>> > > > Why did not you simply called the balancer? If other tables are
>> > > > already balanced, it should not touch them and will only balance
>> > > > the table which is not balancer?
>> > > >
>> > > > JM
>> > > >
>> > > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
>> > > > I choose to move region manually. Any other approaching?
>> > > >
>> > > >
>> > > > 0.94.1
>> > > >
>> > > > Any cmd in shell? Or I need to change balance threshold to 0 an
>> > > > run global balancer cmd in shell?
>> > > >
>> > > >
>> > > >
>> > > > Best Regards,
>> > > > Raymond Liu
>> > > >
>> > > > -----Original Message-----
>> > > > From: Ted Yu [mailto:[EMAIL PROTECTED]]
>> > > > Sent: Wednesday, February 20, 2013 9:09 AM
>> > > > To: [EMAIL PROTECTED]
>> > > > Subject: Re: Is there any way to balance one table?
>> > > >
>> > > > What version of HBase are you using ?
>> > > >
>> > > > 0.94 has per-table load balancing.
>> > > >
>> > > > Cheers
>> > > >
>> > > > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
>> > > > <[EMAIL PROTECTED]>
>> > > > wrote:
>> > > >
>> > > > Hi
>> > > >
>> > > > Is there any way to balance just one table? I found one of my
>> > > > table is not balanced, while all the other table is balanced. So I
>> > > > want to fix this table.
>> > > >
>> > > > Best Regards,
>> > > > Raymond Liu
>> > > >
>> > > >
>> > > >
>>
Yes, tables are balanced on by one. Balancer is taking one table,
looking if it's already balancer or not, do the required move if any
is needed, and then move to the next table.
In your example, average is 23.25. 20% is 4.65. So everything between
18.6 and 27.9 should be ok. So balancer should remove some regions for
the 3rd server (19 i/30/23/21).
If you want to have that more evenly balanced, reduce the
hbase.regions.slop value to something lower, like 0.1 or even 0.05.
Don't go too low else it will never stop balancing the table each 5
minutes.
JM
2013/2/20, Liu, Raymond <[EMAIL PROTECTED]>:
> You mean slop is also base on per table?
> Weird, then it should work for my case.... let me check again.
>
> Best Regards,
> Raymond Liu
>
>>
>> bq. On a 3000 region cluster
>>
>> Balancing is per-table. Meaning total number of regions doesn't come into
>> play.
>>
>> On Tue, Feb 19, 2013 at 7:55 PM, Liu, Raymond <[EMAIL PROTECTED]>
>> wrote:
>>
>> > Hmm, in order to have the 96 region table be balanced within 20% On a
>> > 3000 region cluster when all other table is balanced.
>> >
>> > the slop will need to be around 20%/30, say 0.006? won't it be too
>> > small?
>> >
>> > >
>> > > Yes, Raymond.
>> > > You should lower sloppiness.
>> > >
>> > > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond
>> > > <[EMAIL PROTECTED]>
>> > > wrote:
>> > >
>> > > > I mean region number is small.
>> > > >
>> > > > Overall I have say 3000 region on 4 node, while this table only
>> > > > have
>> > > > 96 region. It won't be 24 for each region server, instead , will
>> > > > be something like 19/30/23/21 etc.
>> > > >
>> > > > This means that I need to limit the slop to 0.02 etc? so that the
>> > > > balancer actually run on this table?
>> > > >
>> > > > Best Regards,
>> > > > Raymond Liu
>> > > >
>> > > > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
>> > > > Sent: Wednesday, February 20, 2013 11:44 AM
>> > > > To: [EMAIL PROTECTED]
>> > > > Cc: Liu, Raymond
>> > > > Subject: Re: Is there any way to balance one table?
>> > > >
>> > > > What is the size of your table?
>> > > > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
>> > > > Hi
>> > > >
>> > > > I do call balancer, while it seems it doesn't work. Might due to
>> > > > this table is small and overall region number difference is within
>> > threshold?
>> > > >
>> > > > -----Original Message-----
>> > > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
>> > > > Sent: Wednesday, February 20, 2013 10:59 AM
>> > > > To: [EMAIL PROTECTED]
>> > > > Subject: Re: Is there any way to balance one table?
>> > > >
>> > > > Hi Liu,
>> > > >
>> > > > Why did not you simply called the balancer? If other tables are
>> > > > already balanced, it should not touch them and will only balance
>> > > > the table which is not balancer?
>> > > >
>> > > > JM
>> > > >
>> > > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
>> > > > I choose to move region manually. Any other approaching?
>> > > >
>> > > >
>> > > > 0.94.1
>> > > >
>> > > > Any cmd in shell? Or I need to change balance threshold to 0 an
>> > > > run global balancer cmd in shell?
>> > > >
>> > > >
>> > > >
>> > > > Best Regards,
>> > > > Raymond Liu
>> > > >
>> > > > -----Original Message-----
>> > > > From: Ted Yu [mailto:[EMAIL PROTECTED]]
>> > > > Sent: Wednesday, February 20, 2013 9:09 AM
>> > > > To: [EMAIL PROTECTED]
>> > > > Subject: Re: Is there any way to balance one table?
>> > > >
>> > > > What version of HBase are you using ?
>> > > >
>> > > > 0.94 has per-table load balancing.
>> > > >
>> > > > Cheers
>> > > >
>> > > > On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
>> > > > <[EMAIL PROTECTED]>
>> > > > wrote:
>> > > >
>> > > > Hi
>> > > >
>> > > > Is there any way to balance just one table? I found one of my
>> > > > table is not balanced, while all the other table is balanced. So I
>> > > > want to fix this table.
>> > > >
>> > > > Best Regards,
>> > > > Raymond Liu
>> > > >
>> > > >
>> > > >
>>
-
Re: Is there any way to balance one table?Ted Yu 2013-02-20, 15:07
bq. Don't go too low else it will never stop balancing the table each 5
minutes.
That shouldn't happen - balancer will stop if the difference between
highest number of regions and lowest becomes 1.
Cheers
On Wed, Feb 20, 2013 at 4:19 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi Raymond,
>
> Yes, tables are balanced on by one. Balancer is taking one table,
> looking if it's already balancer or not, do the required move if any
> is needed, and then move to the next table.
>
> In your example, average is 23.25. 20% is 4.65. So everything between
> 18.6 and 27.9 should be ok. So balancer should remove some regions for
> the 3rd server (19 i/30/23/21).
>
> If you want to have that more evenly balanced, reduce the
> hbase.regions.slop value to something lower, like 0.1 or even 0.05.
> Don't go too low else it will never stop balancing the table each 5
> minutes.
>
> JM
>
> 2013/2/20, Liu, Raymond <[EMAIL PROTECTED]>:
> > You mean slop is also base on per table?
> > Weird, then it should work for my case.... let me check again.
> >
> > Best Regards,
> > Raymond Liu
> >
> >>
> >> bq. On a 3000 region cluster
> >>
> >> Balancing is per-table. Meaning total number of regions doesn't come
> into
> >> play.
> >>
> >> On Tue, Feb 19, 2013 at 7:55 PM, Liu, Raymond <[EMAIL PROTECTED]>
> >> wrote:
> >>
> >> > Hmm, in order to have the 96 region table be balanced within 20% On a
> >> > 3000 region cluster when all other table is balanced.
> >> >
> >> > the slop will need to be around 20%/30, say 0.006? won't it be too
> >> > small?
> >> >
> >> > >
> >> > > Yes, Raymond.
> >> > > You should lower sloppiness.
> >> > >
> >> > > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond
> >> > > <[EMAIL PROTECTED]>
> >> > > wrote:
> >> > >
> >> > > > I mean region number is small.
> >> > > >
> >> > > > Overall I have say 3000 region on 4 node, while this table only
> >> > > > have
> >> > > > 96 region. It won't be 24 for each region server, instead , will
> >> > > > be something like 19/30/23/21 etc.
> >> > > >
> >> > > > This means that I need to limit the slop to 0.02 etc? so that the
> >> > > > balancer actually run on this table?
> >> > > >
> >> > > > Best Regards,
> >> > > > Raymond Liu
> >> > > >
> >> > > > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> >> > > > Sent: Wednesday, February 20, 2013 11:44 AM
> >> > > > To: [EMAIL PROTECTED]
> >> > > > Cc: Liu, Raymond
> >> > > > Subject: Re: Is there any way to balance one table?
> >> > > >
> >> > > > What is the size of your table?
> >> > > > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> >> > > > Hi
> >> > > >
> >> > > > I do call balancer, while it seems it doesn't work. Might due to
> >> > > > this table is small and overall region number difference is within
> >> > threshold?
> >> > > >
> >> > > > -----Original Message-----
> >> > > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> >> > > > Sent: Wednesday, February 20, 2013 10:59 AM
> >> > > > To: [EMAIL PROTECTED]
> >> > > > Subject: Re: Is there any way to balance one table?
> >> > > >
> >> > > > Hi Liu,
> >> > > >
> >> > > > Why did not you simply called the balancer? If other tables are
> >> > > > already balanced, it should not touch them and will only balance
> >> > > > the table which is not balancer?
> >> > > >
> >> > > > JM
> >> > > >
> >> > > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> >> > > > I choose to move region manually. Any other approaching?
> >> > > >
> >> > > >
> >> > > > 0.94.1
> >> > > >
> >> > > > Any cmd in shell? Or I need to change balance threshold to 0 an
> >> > > > run global balancer cmd in shell?
> >> > > >
> >> > > >
> >> > > >
> >> > > > Best Regards,
> >> > > > Raymond Liu
> >> > > >
> >> > > > -----Original Message-----
> >> > > > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> >> > > > Sent: Wednesday, February 20, 2013 9:09 AM
> >> > > > To: [EMAIL PROTECTED]
> >> > > > Subject: Re: Is there any way to balance one table?
> >> > > >
> >> > > > What version of HBase are you using ?
minutes.
That shouldn't happen - balancer will stop if the difference between
highest number of regions and lowest becomes 1.
Cheers
On Wed, Feb 20, 2013 at 4:19 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi Raymond,
>
> Yes, tables are balanced on by one. Balancer is taking one table,
> looking if it's already balancer or not, do the required move if any
> is needed, and then move to the next table.
>
> In your example, average is 23.25. 20% is 4.65. So everything between
> 18.6 and 27.9 should be ok. So balancer should remove some regions for
> the 3rd server (19 i/30/23/21).
>
> If you want to have that more evenly balanced, reduce the
> hbase.regions.slop value to something lower, like 0.1 or even 0.05.
> Don't go too low else it will never stop balancing the table each 5
> minutes.
>
> JM
>
> 2013/2/20, Liu, Raymond <[EMAIL PROTECTED]>:
> > You mean slop is also base on per table?
> > Weird, then it should work for my case.... let me check again.
> >
> > Best Regards,
> > Raymond Liu
> >
> >>
> >> bq. On a 3000 region cluster
> >>
> >> Balancing is per-table. Meaning total number of regions doesn't come
> into
> >> play.
> >>
> >> On Tue, Feb 19, 2013 at 7:55 PM, Liu, Raymond <[EMAIL PROTECTED]>
> >> wrote:
> >>
> >> > Hmm, in order to have the 96 region table be balanced within 20% On a
> >> > 3000 region cluster when all other table is balanced.
> >> >
> >> > the slop will need to be around 20%/30, say 0.006? won't it be too
> >> > small?
> >> >
> >> > >
> >> > > Yes, Raymond.
> >> > > You should lower sloppiness.
> >> > >
> >> > > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond
> >> > > <[EMAIL PROTECTED]>
> >> > > wrote:
> >> > >
> >> > > > I mean region number is small.
> >> > > >
> >> > > > Overall I have say 3000 region on 4 node, while this table only
> >> > > > have
> >> > > > 96 region. It won't be 24 for each region server, instead , will
> >> > > > be something like 19/30/23/21 etc.
> >> > > >
> >> > > > This means that I need to limit the slop to 0.02 etc? so that the
> >> > > > balancer actually run on this table?
> >> > > >
> >> > > > Best Regards,
> >> > > > Raymond Liu
> >> > > >
> >> > > > From: Marcos Ortiz [mailto:[EMAIL PROTECTED]]
> >> > > > Sent: Wednesday, February 20, 2013 11:44 AM
> >> > > > To: [EMAIL PROTECTED]
> >> > > > Cc: Liu, Raymond
> >> > > > Subject: Re: Is there any way to balance one table?
> >> > > >
> >> > > > What is the size of your table?
> >> > > > On 02/19/2013 10:40 PM, Liu, Raymond wrote:
> >> > > > Hi
> >> > > >
> >> > > > I do call balancer, while it seems it doesn't work. Might due to
> >> > > > this table is small and overall region number difference is within
> >> > threshold?
> >> > > >
> >> > > > -----Original Message-----
> >> > > > From: Jean-Marc Spaggiari [mailto:[EMAIL PROTECTED]]
> >> > > > Sent: Wednesday, February 20, 2013 10:59 AM
> >> > > > To: [EMAIL PROTECTED]
> >> > > > Subject: Re: Is there any way to balance one table?
> >> > > >
> >> > > > Hi Liu,
> >> > > >
> >> > > > Why did not you simply called the balancer? If other tables are
> >> > > > already balanced, it should not touch them and will only balance
> >> > > > the table which is not balancer?
> >> > > >
> >> > > > JM
> >> > > >
> >> > > > 2013/2/19, Liu, Raymond <[EMAIL PROTECTED]>:
> >> > > > I choose to move region manually. Any other approaching?
> >> > > >
> >> > > >
> >> > > > 0.94.1
> >> > > >
> >> > > > Any cmd in shell? Or I need to change balance threshold to 0 an
> >> > > > run global balancer cmd in shell?
> >> > > >
> >> > > >
> >> > > >
> >> > > > Best Regards,
> >> > > > Raymond Liu
> >> > > >
> >> > > > -----Original Message-----
> >> > > > From: Ted Yu [mailto:[EMAIL PROTECTED]]
> >> > > > Sent: Wednesday, February 20, 2013 9:09 AM
> >> > > > To: [EMAIL PROTECTED]
> >> > > > Subject: Re: Is there any way to balance one table?
> >> > > >
> >> > > > What version of HBase are you using ?
