Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HDFS Restart with Replication


Copy link to this message
-
Re: HDFS Restart with Replication
I can't think of a way how your missing blocks would be related to
HBase replication, there's something else going on. Are all the
datanodes checking back in?

J-D

On Thu, Aug 1, 2013 at 2:17 PM, Patrick Schless
<[EMAIL PROTECTED]> wrote:
> I'm running:
> CDH4.1.2
> HBase 0.92.1
> Hadoop 2.0.0
>
> Is there an issue with restarting a standby cluster with replication
> running? I am doing the following on the standby cluster:
>
> - stop hmaster
> - stop name_node
> - start name_node
> - start hmaster
>
> When the name node comes back up, it's reliably missing blocks. I started
> with 0 missing blocks, and have run through this scenario a few times, and
> am up to 46 missing blocks, all from the table that is the standby for our
> production table (in a different datacenter). The missing blocks all are
> from the same table, and look like:
>
> blk_-2036986832155369224 /hbase/splitlog/data01.sea01.staging.tdb.com
> ,60020,1372703317824_hdfs%3A%2F%2Fname-node.sea01.staging.tdb.com
> %3A8020%2Fhbase%2F.logs%2Fdata05.sea01.staging.tdb.com
> %2C60020%2C1373557074890-splitting%2Fdata05.sea01.staging.tdb.com
> %252C60020%252C1373557074890.1374960698485/tempodb-data/c9cdd64af0bfed70da154c219c69d62d/recovered.edits/0000000001366319450.temp
>
> Do I have to stop replication before restarting the standby?
>
> Thanks,
> Patrick
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB