Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> AssignmentManager looping?


Copy link to this message
-
Re: AssignmentManager looping?
I can't check the meta since HBase is down.

Regarding HDFS, I took few random lines like:
2013-08-01 08:45:57,260 WARN
org.apache.hadoop.hbase.master.AssignmentManager: Region
28328fdb7181cbd9cc4d6814775e8895 not found on server
node4,60020,1375319042033; failed processing
2013-08-01 08:45:57,260 WARN
org.apache.hadoop.hbase.master.AssignmentManager: Received SPLIT for region
28328fdb7181cbd9cc4d6814775e8895 from server node4,60020,1375319042033 but
it doesn't exist anymore, probably already processed its split

And each time, there is nothing like that.
hadoop@node3:~/hadoop-1.0.3$ bin/hadoop fs -lsr / | grep
28328fdb7181cbd9cc4d6814775e8895

On ZK side:
[zk: localhost:2181(CONNECTED) 3] ls /hbase/splitlog

[zk: localhost:2181(CONNECTED) 10] ls /hbase/unassigned
[28328fdb7181cbd9cc4d6814775e8895, a8781a598c46f19723a2405345b58470,
b7ebfeb63b10997736fd12920fde2bb8, d95bb27cc026511c2a8c8ad155e79bf6,
270a9c371fcbe9cd9a04986e0b77d16b, aff4d1d8bf470458bb19525e8aef0759]

Can I just delete those zknodes? Worst case hbck will find them back from
HDFS if required?

JM

2013/8/1 Kevin O'dell <[EMAIL PROTECTED]>

> Does it exist in meta or hdfs?
> On Aug 1, 2013 8:24 AM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]>
> wrote:
>
> > My master keep logging that:
> >
> > 2013-07-31 21:52:59,201 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Region
> > 270a9c371fcbe9cd9a04986e0b77d16b not found on server
> > node7,60020,1375319044055; failed processing
> > 2013-07-31 21:52:59,201 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Received SPLIT for
> region
> > 270a9c371fcbe9cd9a04986e0b77d16b from server node7,60020,1375319044055
> but
> > it doesn't exist anymore, probably already processed its split
> > 2013-07-31 21:52:59,339 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Region
> > 270a9c371fcbe9cd9a04986e0b77d16b not found on server
> > node7,60020,1375319044055; failed processing
> > 2013-07-31 21:52:59,339 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Received SPLIT for
> region
> > 270a9c371fcbe9cd9a04986e0b77d16b from server node7,60020,1375319044055
> but
> > it doesn't exist anymore, probably already processed its split
> > 2013-07-31 21:52:59,461 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Region
> > 270a9c371fcbe9cd9a04986e0b77d16b not found on server
> > node7,60020,1375319044055; failed processing
> > 2013-07-31 21:52:59,461 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Received SPLIT for
> region
> > 270a9c371fcbe9cd9a04986e0b77d16b from server node7,60020,1375319044055
> but
> > it doesn't exist anymore, probably already processed its split
> > 2013-07-31 21:52:59,636 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Region
> > 270a9c371fcbe9cd9a04986e0b77d16b not found on server
> > node7,60020,1375319044055; failed processing
> > 2013-07-31 21:52:59,636 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Received SPLIT for
> region
> > 270a9c371fcbe9cd9a04986e0b77d16b from server node7,60020,1375319044055
> but
> > it doesn't exist anymore, probably already processed its split
> > 2013-07-31 21:53:00,074 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Region
> > 270a9c371fcbe9cd9a04986e0b77d16b not found on server
> > node7,60020,1375319044055; failed processing
> > 2013-07-31 21:53:00,074 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Received SPLIT for
> region
> > 270a9c371fcbe9cd9a04986e0b77d16b from server node7,60020,1375319044055
> but
> > it doesn't exist anymore, probably already processed its split
> > 2013-07-31 21:53:00,261 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Region
> > 270a9c371fcbe9cd9a04986e0b77d16b not found on server
> > node7,60020,1375319044055; failed processing
> > 2013-07-31 21:53:00,261 WARN
> > org.apache.hadoop.hbase.master.AssignmentManager: Received SPLIT for
> region
> > 270a9c371fcbe9cd9a04986e0b77d16b from server node7,60020,1375319044055
> but
> > it doesn't exist anymore, probably already processed its split
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB