Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Region is not online: .META.,,1


Copy link to this message
-
Region is not online: .META.,,1
Hi,

I have a cluster with 10 RS and 1 Master.
From some reason, any call to the HBase fails. I ran hbck and got the same failure:

Tue Nov 06 13:27:07 UTC 2012, org.apache.hadoop.hbase.client.ScannerCallable@7d8a8ce2, org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region is not online: .META.,,1

at org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:183)
at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:196)
at org.apache.hadoop.hbase.client.MetaScanner.access$000(MetaScanner.java:48)
at org.apache.hadoop.hbase.client.MetaScanner$1.connect(MetaScanner.java:126)
at org.apache.hadoop.hbase.client.MetaScanner$1.connect(MetaScanner.java:123)
at org.apache.hadoop.hbase.client.HConnectionManager.execute(HConnectionManager.java:359)
at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:123)
at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:99)
at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:77)
at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:61)
at org.apache.hadoop.hbase.util.HBaseFsck.loadMetaEntries(HBaseFsck.java:2234)
at org.apache.hadoop.hbase.util.HBaseFsck.onlineConsistencyRepair(HBaseFsck.java:334)
at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:382)
at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:3120)
Anyone has any idea how to fix it without the obvious restart?

+
Mesika, Asaf 2012-11-07, 06:08
+
Mesika, Asaf 2012-11-08, 14:31
+
Leonid Fedotov 2012-11-07, 15:43
+
Mesika, Asaf 2012-11-08, 12:23
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB