Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Re: FileNotFound Exception while ExportSnapshot


+
Siddharth Karandikar 2013-08-06, 10:26
Copy link to this message
-
Re: FileNotFound Exception while ExportSnapshot
Matteo Bertozzi 2013-08-06, 10:29
This looks like HBASE-8455 which was fixed in 0.94.8, 0.95.2

Matteo

On Tue, Aug 6, 2013 at 11:26 AM, Siddharth Karandikar <
[EMAIL PROTECTED]> wrote:

> Fixed the subject.
>
>
>
> On Tue, Aug 6, 2013 at 3:55 PM, Siddharth Karandikar
> <[EMAIL PROTECTED]> wrote:
> > Hi All,
> >
> > I am continuing to tryout ExportSnapshot functionality. Most of the
> > time it works perfectly fine.
> >
> > But recently, I am seeing some strange exception. When I run
> > ExportSnapshot, it shows following error and I have no clue how to
> > debug this.
> >
> > java.io.FileNotFoundException: Unable to open link:
> > org.apache.hadoop.hbase.io.HLogLink
> > locations=[hdfs://
> 10.209.17.88:9000/hbase/.logs/f1/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> 10.209.17.88:9000/hbase/.oldlogs/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ]
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.tryOpen(FileLink.java:305)
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:120)
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:111)
> >         at org.apache.hadoop.hbase.io.FileLink.open(FileLink.java:390)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.openSourceFile(ExportSnapshot.java:299)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyFile(ExportSnapshot.java:168)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:139)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:88)
> >         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >         at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> >         at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
> >
> >
> > Full logs of this Export run can be found here -
> http://pastebin.com/1yxK3fKE
> >
> > If I try to Export this snapshot back (i.e. import), I get following
> error -
> >
> > siddharth@hbase1-bigdata:~/tools/hbase-0.95.1-hadoop1$ ./bin/hbase
> > org.apache.hadoop.hbase.snapshot.ExportSnapshot
> > -Dfs.default.name=hdfs://hbase1-bigdata.vxindia.veritas.com:9000/
> > -Dhbase.rootdir=hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/
> > -snapshot sn2 -copy-to hdfs://10.209.17.88:9000/hbase/
> > Exception in thread "main" java.io.FileNotFoundException: Unable to
> > open link: org.apache.hadoop.hbase.io.HFileLink
> > locations=[hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.tmp/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.archive/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ]
> >         at
> org.apache.hadoop.hbase.io.FileLink.getFileStatus(FileLink.java:376)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$1.storeFile(ExportSnapshot.java:383)
> >         at
> org.apache.hadoop.hbase.util.FSVisitor.visitRegionStoreFiles(FSVisitor.java:115)
> >         at
> org.apache.hadoop.hbase.util.FSVisitor.visitTableStoreFiles(FSVisitor.java:81)
> >         at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitTableStoreFiles(SnapshotReferenceUtil.java:110)
> >         at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitReferencedFiles(SnapshotReferenceUtil.java:95)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.getSnapshotFiles(ExportSnapshot.java:378)
+
Siddharth Karandikar 2013-08-06, 12:12