Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Errors after major compaction


Copy link to this message
-
Re: Errors after major compaction
Eran Kutner 2011-07-01, 12:08
Hi Stack,
I'm not sure what the log means. I do see references to two different
servers, but that would probably happen if there was normal transition I
assume. I'm using version 0.90.3
Here are the relevant lines from the master logs:

2011-06-19 21:39:37,164 INFO org.apache.hadoop.hbase.master.ServerManager:
Received REGION_SPLIT:
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533691659.9000a5d8df9502efc90d2c23567e4658.:
Daughters;
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.,
gs_raw_events,GSLoad_1308518810_1249_WEB204,1308533970928.46f876a4e97be04edb35eb8f8959d482.
from hadoop1-s05.farm-ny.gigya.com,60020,1307349217076
2011-06-19 21:43:12,983 INFO org.apache.hadoop.hbase.catalog.MetaEditor:
Deleted daughter reference
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.,
qualifier=splitA, from parent
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533691659.9000a5d8df9502efc90d2c23567e4658.
2011-06-29 16:29:36,143 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Starting unassignment of
region
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.
(offlining)
2011-06-29 16:29:36,146 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Sent CLOSE to serverNamehadoop1-s05.farm-ny.gigya.com,60020,1307349217076, load=(requests=0,
regions=1654, usedHeap=1870, maxHeap=12483) for region
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.
2011-06-29 16:29:38,327 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling new unassigned
node: /hbase/unassigned/584dac5cc70d8682f71c4675a843c309
(region=gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.,
server=hadoop1-s05.farm-ny.gigya.com,60020,1307349217076,
state=RS_ZK_REGION_CLOSED)
2011-06-29 16:29:38,327 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling
transition=RS_ZK_REGION_CLOSED,
server=hadoop1-s05.farm-ny.gigya.com,60020,1307349217076,
region=584dac5cc70d8682f71c4675a843c309
2011-06-29 16:30:53,742 DEBUG
org.apache.hadoop.hbase.master.handler.ClosedRegionHandler: Handling CLOSED
event for 584dac5cc70d8682f71c4675a843c309
2011-06-29 16:30:53,742 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Table being disabled so
deleting ZK node and removing from regions in transition, skipping
assignment of region
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.
2011-06-29 16:30:53,742 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x13004a31d7804c4 Deleting existing unassigned node for
584dac5cc70d8682f71c4675a843c309 that is in expected state
RS_ZK_REGION_CLOSED
2011-06-29 16:30:53,801 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x13004a31d7804c4 Successfully deleted unassigned node for
region 584dac5cc70d8682f71c4675a843c309 in expected state
RS_ZK_REGION_CLOSED
2011-06-29 16:34:01,453 INFO org.apache.hadoop.hbase.catalog.MetaEditor:
Updated region
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.
in META
2011-06-29 16:37:12,247 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x13004a31d7804c4 Creating (or updating) unassigned node for
584dac5cc70d8682f71c4675a843c309 with OFFLINE state
2011-06-29 16:37:12,576 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: No previous transition
plan was found (or we are ignoring an existing plan) for
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.
so generated a random one;
hri=gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.,
src=, dest=hadoop1-s05.farm-ny.gigya.com,60020,1307349217076; 5 (online=5,
exclude=null) available servers
2011-06-29 16:37:12,576 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Assigning region
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.
to hadoop1-s05.farm-ny.gigya.com,60020,1307349217076
2011-06-29 16:37:13,102 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling
transition=RS_ZK_REGION_OPENED,
server=hadoop1-s05.farm-ny.gigya.com,60020,1307349217076,
region=584dac5cc70d8682f71c4675a843c309
2011-06-29 16:39:54,075 DEBUG
org.apache.hadoop.hbase.master.handler.OpenedRegionHandler: Handling OPENED
event for 584dac5cc70d8682f71c4675a843c309; deleting unassigned node
2011-06-29 16:39:54,075 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x13004a31d7804c4 Deleting existing unassigned node for
584dac5cc70d8682f71c4675a843c309 that is in expected state
RS_ZK_REGION_OPENED
2011-06-29 16:39:54,192 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x13004a31d7804c4 Successfully deleted unassigned node for
region 584dac5cc70d8682f71c4675a843c309 in expected state
RS_ZK_REGION_OPENED
2011-06-29 16:39:54,326 DEBUG
org.apache.hadoop.hbase.master.handler.OpenedRegionHandler: Opened region
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.
on hadoop1-s05.farm-ny.gigya.com,60020,1307349217076
2011-06-29 16:40:00,598 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x13004a31d7804c4 Creating (or updating) unassigned node for
584dac5cc70d8682f71c4675a843c309 with OFFLINE state
2011-06-29 16:40:00,877 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: No previous transition
plan was found (or we are ignoring an existing plan) for
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.
so generated a random one;
hri=gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.584dac5cc70d8682f71c4675a843c309.,
src=, dest=hadoop1-s05.farm-ny.gigya.com,60020,1307349217076; 5 (online=5,
exclude=null) available servers
2011-06-29 16:40:00,877 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Assigning region
gs_raw_events,GSLoad_1308518553_168_WEB204,1308533970928.5