Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Load balancer repeatedly close and open region in the same regionserver.


Copy link to this message
-
Re: Load balancer repeatedly close and open region in the same regionserver.
Suraj Varma 2012-07-18, 23:06
You can use pastebin.com or similar services to cut/paste your logs.
--S

On Tue, Jul 17, 2012 at 7:11 PM, Howard <[EMAIL PROTECTED]> wrote:
> this problem just only once,Because it happens two day before,I remember I
> check the master-status and only always see regions is "pending open" in
>  Regions in Transition,not see there was two regionservers in the same
> server.
>
> "Sent CLOSE to 192.168.0.2,60020,1342017399608",what
> does  "60020,1342017399608" mean?Is there some document can help to read
> the source code?
> If still need to upload the log,how to upload the log?
> sorry I am a freshman with HBase.
>
> 2012/7/17 Ted Yu <[EMAIL PROTECTED]>
>
>> Howard:
>> Before filing JIRA, can you verify with 0.94.1 RC that Lars sent out
>> yesterday ?
>> I guess you have noticed the following toward the end of log snippet:
>>
>> 2012-07-16 00:17:50,774 DEBUG
>> org.apache.hadoop.hbase.
>> master.handler.OpenedRegionHandler: Handling OPENED
>> event for
>>
>> trackurl_status_list,zO6u4o8,1342291884831.93caf5147d40f5dd4625e160e1b7e956.
>> from 192.168.1.2,60020,1342017399608; deleting unassigned node
>>
>> As Ram pointed out, there might be two region server processes running on
>> 192.168.1.2
>>
>> Please verify whether that was the case.
>>
>> Cheers
>>
>> On Tue, Jul 17, 2012 at 7:30 AM, Ramkrishna.S.Vasudevan <
>> [EMAIL PROTECTED]> wrote:
>>
>> > From the logs I can see that though the server's are same their start
>> code
>> > is different.
>> > Need to analyse the previous logs also.  Pls file a JIRA, if possible
>> > attach
>> > the logs to that.
>> >
>> > Thanks Howard.
>> >
>> > Regards
>> > Ram
>> >
>> > > -----Original Message-----
>> > > From: Howard [mailto:[EMAIL PROTECTED]]
>> > > Sent: Tuesday, July 17, 2012 7:32 PM
>> > > To: [EMAIL PROTECTED]
>> > > Subject: Re: Load balancer repeatedly close and open region in the same
>> > > regionserver.
>> > >
>> > > *hi,Ted Yu,thanks for your reply:*
>> > > the hbase and hadoop version is
>> > > HBase Version0.94.0, r1332822Hadoop Version0.20.2-cdh3u1,
>> > > rbdafb1dbffd0d5f2fbc6ee022e1c8df6500fd638
>> > > the following is a detail log about the same region
>> > > trackurl_status_list,zO6u4o8,1342291884831.93caf5147d40f5dd4625e160e1b7
>> > > e956,
>> > > and it repeats again and again.:
>> > > 2012-07-16 00:12:49,843 INFO org.apache.hadoop.hbase.master.HMaster:
>> > > balance
>> > > hri=trackurl_status_list,zO6u4o8,1342291884831.93caf5147d40f5dd4625e160
>> > > e1b7e956.,
>> > > src=192.168.1.2,60020,1342017399608,
>> > > dest=192.168.1.2,60020,1342002082592
>> > > 2012-07-16 00:12:49,843 DEBUG
>> > > org.apache.hadoop.hbase.master.AssignmentManager: Starting unassignment
>> > > of
>> > > region
>> > > trackurl_status_list,zO6u4o8,1342291884831.93caf5147d40f5dd4625e160e1b7
>> > > e956.
>> > > (offlining)
>> > > 2012-07-16 00:12:49,843 DEBUG
>> > > org.apache.hadoop.hbase.zookeeper.ZKAssign:
>> > > master:60000-0x4384d0a47f40068 Creating unassigned node for
>> > > 93caf5147d40f5dd4625e160e1b7e956 in a CLOSING state
>> > > 2012-07-16 00:12:49,845 DEBUG
>> > > org.apache.hadoop.hbase.master.AssignmentManager: Sent CLOSE to
>> > > 192.168.1.2,60020,1342017399608 for region
>> > > trackurl_status_list,zO6u4o8,1342291884831.93caf5147d40f5dd4625e160e1b7
>> > > e956.
>> > > 2012-07-16 00:12:50,555 DEBUG
>> > > org.apache.hadoop.hbase.master.AssignmentManager: Handling
>> > > transition=RS_ZK_REGION_CLOSED, server=192.168.1.2,60020,1342017399608,
>> > > region=93caf5147d40f5dd4625e160e1b7e956
>> > > 2012-07-16 00:12:50,555 DEBUG
>> > > org.apache.hadoop.hbase.master.handler.ClosedRegionHandler: Handling
>> > > CLOSED
>> > > event for 93caf5147d40f5dd4625e160e1b7e956
>> > > 2012-07-16 00:12:50,555 DEBUG
>> > > org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE;
>> > > was=trackurl_status_list,zO6u4o8,1342291884831.93caf5147d40f5dd4625e160
>> > > e1b7e956.
>> > > state=CLOSED, ts=1342368770556, server=192.168.1.2,60020,1342017399608
>> > > 2012-07-16 00:12:50,555 DEBUG