Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> export snapshot of cloned table fails


+
Siddharth Karandikar 2013-09-30, 13:36
+
Matteo Bertozzi 2013-09-30, 13:55
+
Siddharth Karandikar 2013-10-01, 05:42
+
Siddharth Karandikar 2013-10-01, 05:43
Copy link to this message
-
Re: export snapshot of cloned table fails
that is a bad hfileLink name creation in the visitReferencedFiles/storeFile
when you have already a hfileLink.
it is fixed in 0.94.12 by HBASE-8760

Matteo

On Tue, Oct 1, 2013 at 6:43 AM, Siddharth Karandikar <
[EMAIL PROTECTED]> wrote:

> Btw, I am running on 0.94.10.
>
> On Tue, Oct 1, 2013 at 11:12 AM, Siddharth Karandikar
> <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > Here is the output of SnapshotInfo
> >
> > hbase2-bigdata:~/siddharth/tools/hbase-0.94.10 # ./bin/hbase
> > org.apache.hadoop.hbase.snapshot.SnapshotInfo
> > -Dfs.default.name=hdfs://hbase2-bigdata.vxindia.veritas.com:9000/
> > -snapshot CMT2SS1 -files
> > Snapshot Info
> > ----------------------------------------
> >    Name: CMT2SS1
> >    Type: FLUSH
> >   Table: CMT2
> >  Format: 0
> > Created: 2013-09-30T07:02:43
> >
> > Snapshot Files
> > ----------------------------------------
> >      0.0
> CMT2/95d51af133141274fe2f0a9da79247cb/f1/MT2=d1bcc79d7e81c481c287cb1b7f6d78e2-9b57efdf5219495ebd15d0e0b227007c
> > 13/09/30 23:41:43 INFO util.FSVisitor: No logs under
> > directory:hdfs://
> hbase2-bigdata.vxindia.veritas.com:9000/hbase/.hbase-snapshot/CMT2SS1/.logs
> >
> > 1 HFiles (0 in archive), total size 0.0 (NaN% 0.0 shared with the source
> table)
> > 0 Logs, total size 0.0
> >
> >
> >
> > Thanks,
> > Siddharth
> >
> > On Mon, Sep 30, 2013 at 7:25 PM, Matteo Bertozzi
> > <[EMAIL PROTECTED]> wrote:
> >> The input name looks wrong, not an hfileLink.
> >> How that was created?
> >> could you dump the snapshots files with hbase
> >> org.apache.hadoop.hbase.SnapshotInfo -snapshot NAME -files
> >>
> >> Matteo
> >>
> >>
> >>
> >> On Mon, Sep 30, 2013 at 2:36 PM, Siddharth Karandikar <
> >> [EMAIL PROTECTED]> wrote:
> >>
> >>> Hi,
> >>>
> >>> I have reached a situation where good old ExportSnapshot fails
> >>>
> >>> Here is what I am doing
> >>>
> >>> 1) Create table MT2
> >>> 2) Take a snapshot of MT2 -> MT2SS1
> >>> 3) Export MT2SS1 - works
> >>>
> >>> 4) Drop MT2, delete MT2SS1 from source system
> >>> 5) Export back (import) MT2SS1 - works
> >>>
> >>> 6) Clone a table using MT2SS1 -> CMT2
> >>> 7) Take a snapshot of CMT2 -> CMT2SS1
> >>> 8) Export CMT2SS1 - FAILS
> >>>
> >>> Though the steps look complex, I feel, it is going to be very common
> >>> to take snapshot of cloned (restored?) table and export that snapshot.
> >>>
> >>> Here is the whole output of ExportSnapshot -
> http://pastebin.com/N1f0Kg1a
> >>>
> >>>
> >>> I think  storeFile (..) in SnapshotReferenceUtil.visitReferencedFiles
> >>> is creating a path like
> >>>
> >>>
> "f1/CMT2=95d51af133141274fe2f0a9da79247cb-MT2=d1bcc79d7e81c481c287cb1b7f6d78e2-9b57efdf5219495ebd15d0e0b227007c"
> >>> which is making it fail later.
> >>>
> >>>
> >>> Thanks,
> >>> Siddharth
> >>>
>
+
Siddharth Karandikar 2013-10-01, 12:17