Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Re: FileNotFound Exception while ExportSnapshot


+
Siddharth Karandikar 2013-08-06, 10:26
Copy link to this message
-
Re: FileNotFound Exception while ExportSnapshot
This looks like HBASE-8455 which was fixed in 0.94.8, 0.95.2

Matteo

On Tue, Aug 6, 2013 at 11:26 AM, Siddharth Karandikar <
[EMAIL PROTECTED]> wrote:

> Fixed the subject.
>
>
>
> On Tue, Aug 6, 2013 at 3:55 PM, Siddharth Karandikar
> <[EMAIL PROTECTED]> wrote:
> > Hi All,
> >
> > I am continuing to tryout ExportSnapshot functionality. Most of the
> > time it works perfectly fine.
> >
> > But recently, I am seeing some strange exception. When I run
> > ExportSnapshot, it shows following error and I have no clue how to
> > debug this.
> >
> > java.io.FileNotFoundException: Unable to open link:
> > org.apache.hadoop.hbase.io.HLogLink
> > locations=[hdfs://
> 10.209.17.88:9000/hbase/.logs/f1/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> 10.209.17.88:9000/hbase/.oldlogs/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ]
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.tryOpen(FileLink.java:305)
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:120)
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:111)
> >         at org.apache.hadoop.hbase.io.FileLink.open(FileLink.java:390)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.openSourceFile(ExportSnapshot.java:299)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyFile(ExportSnapshot.java:168)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:139)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:88)
> >         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >         at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> >         at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
> >
> >
> > Full logs of this Export run can be found here -
> http://pastebin.com/1yxK3fKE
> >
> > If I try to Export this snapshot back (i.e. import), I get following
> error -
> >
> > siddharth@hbase1-bigdata:~/tools/hbase-0.95.1-hadoop1$ ./bin/hbase
> > org.apache.hadoop.hbase.snapshot.ExportSnapshot
> > -Dfs.default.name=hdfs://hbase1-bigdata.vxindia.veritas.com:9000/
> > -Dhbase.rootdir=hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/
> > -snapshot sn2 -copy-to hdfs://10.209.17.88:9000/hbase/
> > Exception in thread "main" java.io.FileNotFoundException: Unable to
> > open link: org.apache.hadoop.hbase.io.HFileLink
> > locations=[hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.tmp/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.archive/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ]
> >         at
> org.apache.hadoop.hbase.io.FileLink.getFileStatus(FileLink.java:376)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$1.storeFile(ExportSnapshot.java:383)
> >         at
> org.apache.hadoop.hbase.util.FSVisitor.visitRegionStoreFiles(FSVisitor.java:115)
> >         at
> org.apache.hadoop.hbase.util.FSVisitor.visitTableStoreFiles(FSVisitor.java:81)
> >         at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitTableStoreFiles(SnapshotReferenceUtil.java:110)
> >         at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitReferencedFiles(SnapshotReferenceUtil.java:95)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.getSnapshotFiles(ExportSnapshot.java:378)
+
Siddharth Karandikar 2013-08-06, 12:12
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB