Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> export snapshot of cloned table fails


+
Siddharth Karandikar 2013-09-30, 13:36
+
Matteo Bertozzi 2013-09-30, 13:55
+
Siddharth Karandikar 2013-10-01, 05:42
+
Siddharth Karandikar 2013-10-01, 05:43
Copy link to this message
-
Re: export snapshot of cloned table fails
that is a bad hfileLink name creation in the visitReferencedFiles/storeFile
when you have already a hfileLink.
it is fixed in 0.94.12 by HBASE-8760

Matteo

On Tue, Oct 1, 2013 at 6:43 AM, Siddharth Karandikar <
[EMAIL PROTECTED]> wrote:

> Btw, I am running on 0.94.10.
>
> On Tue, Oct 1, 2013 at 11:12 AM, Siddharth Karandikar
> <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > Here is the output of SnapshotInfo
> >
> > hbase2-bigdata:~/siddharth/tools/hbase-0.94.10 # ./bin/hbase
> > org.apache.hadoop.hbase.snapshot.SnapshotInfo
> > -Dfs.default.name=hdfs://hbase2-bigdata.vxindia.veritas.com:9000/
> > -snapshot CMT2SS1 -files
> > Snapshot Info
> > ----------------------------------------
> >    Name: CMT2SS1
> >    Type: FLUSH
> >   Table: CMT2
> >  Format: 0
> > Created: 2013-09-30T07:02:43
> >
> > Snapshot Files
> > ----------------------------------------
> >      0.0
> CMT2/95d51af133141274fe2f0a9da79247cb/f1/MT2=d1bcc79d7e81c481c287cb1b7f6d78e2-9b57efdf5219495ebd15d0e0b227007c
> > 13/09/30 23:41:43 INFO util.FSVisitor: No logs under
> > directory:hdfs://
> hbase2-bigdata.vxindia.veritas.com:9000/hbase/.hbase-snapshot/CMT2SS1/.logs
> >
> > 1 HFiles (0 in archive), total size 0.0 (NaN% 0.0 shared with the source
> table)
> > 0 Logs, total size 0.0
> >
> >
> >
> > Thanks,
> > Siddharth
> >
> > On Mon, Sep 30, 2013 at 7:25 PM, Matteo Bertozzi
> > <[EMAIL PROTECTED]> wrote:
> >> The input name looks wrong, not an hfileLink.
> >> How that was created?
> >> could you dump the snapshots files with hbase
> >> org.apache.hadoop.hbase.SnapshotInfo -snapshot NAME -files
> >>
> >> Matteo
> >>
> >>
> >>
> >> On Mon, Sep 30, 2013 at 2:36 PM, Siddharth Karandikar <
> >> [EMAIL PROTECTED]> wrote:
> >>
> >>> Hi,
> >>>
> >>> I have reached a situation where good old ExportSnapshot fails
> >>>
> >>> Here is what I am doing
> >>>
> >>> 1) Create table MT2
> >>> 2) Take a snapshot of MT2 -> MT2SS1
> >>> 3) Export MT2SS1 - works
> >>>
> >>> 4) Drop MT2, delete MT2SS1 from source system
> >>> 5) Export back (import) MT2SS1 - works
> >>>
> >>> 6) Clone a table using MT2SS1 -> CMT2
> >>> 7) Take a snapshot of CMT2 -> CMT2SS1
> >>> 8) Export CMT2SS1 - FAILS
> >>>
> >>> Though the steps look complex, I feel, it is going to be very common
> >>> to take snapshot of cloned (restored?) table and export that snapshot.
> >>>
> >>> Here is the whole output of ExportSnapshot -
> http://pastebin.com/N1f0Kg1a
> >>>
> >>>
> >>> I think  storeFile (..) in SnapshotReferenceUtil.visitReferencedFiles
> >>> is creating a path like
> >>>
> >>>
> "f1/CMT2=95d51af133141274fe2f0a9da79247cb-MT2=d1bcc79d7e81c481c287cb1b7f6d78e2-9b57efdf5219495ebd15d0e0b227007c"
> >>> which is making it fail later.
> >>>
> >>>
> >>> Thanks,
> >>> Siddharth
> >>>
>
+
Siddharth Karandikar 2013-10-01, 12:17
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB