Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HBase 0.94.10 snapshot FileNotFoundException exception


Copy link to this message
-
Re: HBase 0.94.10 snapshot FileNotFoundException exception
Thanks for confirming the issue.So, to overcome this issue we need to move
from 0.94.10 to either 0.94.12 or above.

Thanks
-OC
On Tue, Dec 10, 2013 at 4:09 PM, Matteo Bertozzi <[EMAIL PROTECTED]>wrote:

> Hi,  thank you for the follow up.
>
> The problem is related to a bug in the name resolution of a "clone" (that
> in your case the is the restore of a snapshot of a restored table).
> This problem was fixed as part of HBASE-8760, which should be integrated in
> 0.94.12
>
>
> Matteo
>
>
>
> On Tue, Dec 10, 2013 at 10:00 AM, oc tsdb <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > Thanks for your help.
> >
> > More details are added below.Please let us know if any additional logs
> > required.
> >
> > We have only one cluster (cluster-1) with 1 NN and with 4 DNs and HBase
> > version is 0.94.10
> >
> > We are using hbase shell to Create, Export snapshots.
> >
> > In short, what we are trying to do is:
> >
> > -Create snapshots for all HBase tables on cluster-1 and exporte to local
> > file system.
> >    Here exported data contains archive+hbase-snapshot
> > -Remove everything from Cluster-1 and importe all exported snapshots from
> > local file system to same cluster-1.
> >  Working fine without any issues.
> > -Again,after restoring snapshots, create snapshots for all HBase tables
> on
> > cluster-1 and exporte to local file system
> >   Exported data contains only hbase-snapshot but not archive directory.
> >   As we don't have archive directory, snapshot restore is failing with
> > FileNotFoundException.
> >
> > Basically snapshot export on restored snapshot data is not working in our
> > case.
> >
> > Detailed Steps are given below:
> >
> > 1.Created snapshots for all HBase tables on  cluster-1
> >
> > snapshot 'tsdb', 'tsdb_snap_backup'
> > snapshot 'tsdb-meta', 'tsdb-meta_snap_backup'
> > snapshot 'tsdb-tree', 'tsdb-tree_snap_backup'
> > snapshot 'tsdb-uid', 'tsdb-uid_snap_backup'
> >
> > 2.Exported above snapshots to same cluster(cluster-1) under hdfs root
> > (/tsdb_full_backup_2013-12-09_23.32.19)
> >
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> > tsdb_snap_backup -copy-to /tsdb_full_backup_2013-12-09_23.32.19 -mappers
> > 16;
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> >  tsdb-meta_snap_backup -copy-to /tsdb_full_backup_2013-12-09_23.32.19
> > -mappers 16;
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> >  tsdb-tree_snap_backup -copy-to /tsdb_full_backup_2013-12-09_23.32.19
> > -mappers 16;
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> >  tsdb-uid_snap_backup -copy-to /tsdb_full_backup_2013-12-09_23.32.19
> > -mappers 16;
> >
> >
> > 3. Copied /tsdb_full_backup_2013-12-09_23.32.19 to local file system
> >
> > /opt/airwave/lib/hadoop/bin/hadoop fs -get
> > /tsdb_full_backup_2013-12-09_23.32.19 /tmp/
> >
> > We could see archive+hbase-snapshot directories copied to local file
> system
> > /tmp/tsdb_full_backup_2013-12-09_23.32.19
> >
> > 4. Formatted cluster-1
> > Remove everything from Cluster-1.Now its fresh cluster.
> >
> > 5. copied /tmp/tsdb_full_backup_2013-12-09_23.32.19/ to hdfs path (root
> > dir)
> >
> > /opt/airwave/lib/hadoop/bin/hadoop fs -put
> > /tmp/tsdb_full_backup_2013-12-09_23.32.19 /
> >
> > 6.Import snapshots from hdfs path /tsdb_full_backup_2013-12-09_23.32.19
> >
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -D
> > hbase.rootdir=hdfs:/tsdb_full_backup_2013-12-09_23.32.19 -snapshot
> > tsdb_snap_backup -copy-to hdfs:/hbase
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -D
> > hbase.rootdir=hdfs:/tsdb_full_backup_2013-12-09_23.32.19 -snapshot
> > tsdb-meta_snap_backup -copy-to hdfs:/hbase
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -D
> > hbase.rootdir=hdfs:/tsdb_full_backup_2013-12-09_23.32.19 -snapshot
> > tsdb-tree_snap_backup -copy-to hdfs:/hbase
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -D
> > hbase.rootdir=hdfs:/tsdb_full_backup_2013-12-09_23.32.19 -snapshot
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB