Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> hbase hbck logging


Copy link to this message
-
Re: hbase hbck logging
Jay,

Have you tried the -metaOnly hbck option (possibly in conjunction with
-fixAssignments/-fix)?  It could be that meta is out of whack which
prevents everything else from making progress.

If that doesn't work please share more logs -- it will help us figure out
where it got stuck.

Thanks,
Jon.

On Wed, Jul 4, 2012 at 8:38 AM, Jay Whittaker <[EMAIL PROTECTED]
> wrote:

> Hey,
>
> I have been getting the following in thrift logs.
>
> 2012-07-04 15:41:05,903 WARN
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation:
> Encountered problems when prefetch META table:
> org.apache.hadoop.hbase.TableNotFoundException: Cannot find row in .META.
> for table: finalfrontier, row=finalfrontier,,99999999999999
>
> Which made us think it's a META table error. So we ran 'bin/hbase hbck'
> and 'bin/hbase hbck –details' and both seem to hang after a 'HregionInfo
> read' line before dropping to the CLI with no error or debug info.
>
> We presume it is a Hregion read hanging but can not find it logged
> anywhere. Is there a way to see where it is hanging?
>
> It may also be worth pointing out we have tried the –fix –fixMeta and
> –repair tags with no change.
>
> Thanks,
>
> Jay
>

--
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB