Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HBase ExportSnapshot


Copy link to this message
-
Re: HBase ExportSnapshot
I think that error is  because of missing .archive files?

We only see this issue when we export snapshot to local file system
(file:///tmp/hbase_backup)
but not when we export snapshot to hdfs.

When we export snapshot to hdfs we are getting all the data.Its only not
working when we export snapshot data to local file system directly?

On Tue, Dec 3, 2013 at 5:39 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Please check what happened to the HFileLink mentioned in the exception
> below - this would be the cause for snapshot export failure:
>
> Exception in thread "main" java.io.FileNotFoundException: Unable to open
> link: org.apache.hadoop.hbase.io.HFileLink locations=[hdfs://
>
> site.com:54310/data_full_backup_2013-12-02_21.49.20/tsdb-uid/f9e5e554f111dc0679dfc8069b282ff7/id/ed071cd010534856adc4be997498d645
> ,
> hdfs://
>
> site.com:54310/data_full_backup_2013-12-02_21.49.20/.tmp/tsdb-uid/f9e5e554f111dc0679dfc8069b282ff7/id/ed071cd010534856adc4be997498d645
> ,
> hdfs://
>
> site.com:54310/data_full_backup_2013-12-02_21.49.20/.archive/tsdb-uid/f9e5e554f111dc0679dfc8069b282ff7/id/ed071cd010534856adc4be997498d645
> ]
>         at
> org.apache.hadoop.hbase.io.FileLink.getFileStatus(FileLink.java:376)
>
>
> On Mon, Dec 2, 2013 at 10:01 PM, oc tsdb <[EMAIL PROTECTED]> wrote:
>
> > here is snapshot export logs.
> >
> > mastre log:
> > ==========> > 2013-12-02 21:54:30,840 INFO org.apache.hadoop.hbase.master.LoadBalancer:
> > Skipping load balancing because balanced cluster; servers=1 regions=1
> > average=1.0 mostloaded=1 leastloaded=1
> > 2013-12-02 21:54:30,841 INFO org.apache.hadoop.hbase.master.LoadBalancer:
> > Skipping load balancing because balanced cluster; servers=1 regions=1
> > average=1.0 mostloaded=1 leastloaded=1
> > 2013-12-02 21:54:30,841 INFO org.apache.hadoop.hbase.master.LoadBalancer:
> > Skipping load balancing because balanced cluster; servers=1 regions=1
> > average=1.0 mostloaded=1 leastloaded=1
> > 2013-12-02 21:54:30,841 INFO org.apache.hadoop.hbase.master.LoadBalancer:
> > Skipping load balancing because balanced cluster; servers=1 regions=1
> > average=1.0 mostloaded=1 leastloaded=1
> >
> > snapshot export console log:
> > ============================> >
> > 2013-12-02 21:54:30,841 INFO org.apache.hadoop.hbase.master.LoadBalancer:
> > Skipping load balancing because balanced cluster; servers=1 regions=1
> > average=1.0 mostloaded=1 leastloaded=1
> > 2013-12-02 21:54:30,841 INFO org.apache.hadoop.hbase.master.LoadBalancer:
> > Skipping load balancing because balanced cluster; servers=1 regions=1
> > average=1.0 mostloaded=1 leastloaded=1
> >
> >         at
> >
> >
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitReferencedFiles(SnapshotReferenceUtil.java:101)
> >         at
> >
> >
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.getSnapshotFiles(ExportSnapshot.java:385)
> >         at
> >
> >
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.run(ExportSnapshot.java:633)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >         at
> >
> >
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.innerMain(ExportSnapshot.java:705)
> >         at
> >
> >
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.main(ExportSnapshot.java:709)
> > 13/12/02 21:54:24 INFO util.FSVisitor: No families under region
> > directory:hdfs://
> >
> >
> site.com:54310/data_full_backup_2013-12-02_21.49.20/.hbase-snapshot/tsdb-meta_snap_backup/f06335933b32019c4369f95001d996fb
> > 13/12/02 21:54:24 INFO util.FSVisitor: No logs under directory:hdfs://
> >
> >
> site.com:54310/data_full_backup_2013-12-02_21.49.20/.hbase-snapshot/tsdb-meta_snap_backup/.logs
> > 13/12/02 21:54:24 WARN snapshot.ExportSnapshot: There are 0 store file to
> > be copied. There may be no data in the table.
> > 13/12/02 21:54:25 INFO util.FSVisitor: No families under region
> > directory:hdfs://
> >
> >
> site.com:54310/data_full_backup_2013-12-02_21.49.20/.hbase-snapshot/tsdb-tree_snap_backup/c40c34c4312ccb3302fbaf62caa91b9c
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB