Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HBase 0.94.10 snapshot FileNotFoundException exception


Copy link to this message
-
Re: HBase 0.94.10 snapshot FileNotFoundException exception
Thanks for confirming the issue.So, to overcome this issue we need to move
from 0.94.10 to either 0.94.12 or above.

Thanks
-OC
On Tue, Dec 10, 2013 at 4:09 PM, Matteo Bertozzi <[EMAIL PROTECTED]>wrote:

> Hi,  thank you for the follow up.
>
> The problem is related to a bug in the name resolution of a "clone" (that
> in your case the is the restore of a snapshot of a restored table).
> This problem was fixed as part of HBASE-8760, which should be integrated in
> 0.94.12
>
>
> Matteo
>
>
>
> On Tue, Dec 10, 2013 at 10:00 AM, oc tsdb <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > Thanks for your help.
> >
> > More details are added below.Please let us know if any additional logs
> > required.
> >
> > We have only one cluster (cluster-1) with 1 NN and with 4 DNs and HBase
> > version is 0.94.10
> >
> > We are using hbase shell to Create, Export snapshots.
> >
> > In short, what we are trying to do is:
> >
> > -Create snapshots for all HBase tables on cluster-1 and exporte to local
> > file system.
> >    Here exported data contains archive+hbase-snapshot
> > -Remove everything from Cluster-1 and importe all exported snapshots from
> > local file system to same cluster-1.
> >  Working fine without any issues.
> > -Again,after restoring snapshots, create snapshots for all HBase tables
> on
> > cluster-1 and exporte to local file system
> >   Exported data contains only hbase-snapshot but not archive directory.
> >   As we don't have archive directory, snapshot restore is failing with
> > FileNotFoundException.
> >
> > Basically snapshot export on restored snapshot data is not working in our
> > case.
> >
> > Detailed Steps are given below:
> >
> > 1.Created snapshots for all HBase tables on  cluster-1
> >
> > snapshot 'tsdb', 'tsdb_snap_backup'
> > snapshot 'tsdb-meta', 'tsdb-meta_snap_backup'
> > snapshot 'tsdb-tree', 'tsdb-tree_snap_backup'
> > snapshot 'tsdb-uid', 'tsdb-uid_snap_backup'
> >
> > 2.Exported above snapshots to same cluster(cluster-1) under hdfs root
> > (/tsdb_full_backup_2013-12-09_23.32.19)
> >
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> > tsdb_snap_backup -copy-to /tsdb_full_backup_2013-12-09_23.32.19 -mappers
> > 16;
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> >  tsdb-meta_snap_backup -copy-to /tsdb_full_backup_2013-12-09_23.32.19
> > -mappers 16;
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> >  tsdb-tree_snap_backup -copy-to /tsdb_full_backup_2013-12-09_23.32.19
> > -mappers 16;
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> >  tsdb-uid_snap_backup -copy-to /tsdb_full_backup_2013-12-09_23.32.19
> > -mappers 16;
> >
> >
> > 3. Copied /tsdb_full_backup_2013-12-09_23.32.19 to local file system
> >
> > /opt/airwave/lib/hadoop/bin/hadoop fs -get
> > /tsdb_full_backup_2013-12-09_23.32.19 /tmp/
> >
> > We could see archive+hbase-snapshot directories copied to local file
> system
> > /tmp/tsdb_full_backup_2013-12-09_23.32.19
> >
> > 4. Formatted cluster-1
> > Remove everything from Cluster-1.Now its fresh cluster.
> >
> > 5. copied /tmp/tsdb_full_backup_2013-12-09_23.32.19/ to hdfs path (root
> > dir)
> >
> > /opt/airwave/lib/hadoop/bin/hadoop fs -put
> > /tmp/tsdb_full_backup_2013-12-09_23.32.19 /
> >
> > 6.Import snapshots from hdfs path /tsdb_full_backup_2013-12-09_23.32.19
> >
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -D
> > hbase.rootdir=hdfs:/tsdb_full_backup_2013-12-09_23.32.19 -snapshot
> > tsdb_snap_backup -copy-to hdfs:/hbase
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -D
> > hbase.rootdir=hdfs:/tsdb_full_backup_2013-12-09_23.32.19 -snapshot
> > tsdb-meta_snap_backup -copy-to hdfs:/hbase
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -D
> > hbase.rootdir=hdfs:/tsdb_full_backup_2013-12-09_23.32.19 -snapshot
> > tsdb-tree_snap_backup -copy-to hdfs:/hbase
> > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -D
> > hbase.rootdir=hdfs:/tsdb_full_backup_2013-12-09_23.32.19 -snapshot