Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - NPE in restore_snapshot


+
Lukáš Drbal 2013-08-31, 18:25
+
Ted Yu 2013-08-31, 18:34
+
Lukáš Drbal 2013-08-31, 18:45
Copy link to this message
-
Re: NPE in restore_snapshot
Matteo Bertozzi 2013-09-01, 20:27
one region of the table has no SERVER_QUALIFIER, that means it was never
assigned.
and you get the NPE during the snapshot taken before restoring.
The workaround is drop the table and use clone_snapshot instead.

(The NPE was fixed as part of HBASE-8760, which should be part of 0.94.12)

Matteo

On Sat, Aug 31, 2013 at 7:45 PM, Lukáš Drbal <[EMAIL PROTECTED]> wrote:

> Ach, sorry.
> Hbase 0.94.11 and hadoop 1.0.3
>
>
> 2013/8/31 Ted Yu <[EMAIL PROTECTED]>
>
> > What version of HBase are you using ?
> >
> > According to output, the NPE seems to point to the following line
> > in DisabledTableSnapshotHandler.java (tip of 0.94):
> >
> >       LOG.info("Starting to write region info and WALs for regions for
> > offline snapshot:"
> >           + SnapshotDescriptionUtils.toString(snapshot));
> >
> > It is unlikely the statement which caused NPE. Knowing the release would
> > help pinpoint the exact location.
> >
> > Cheers
> >
> >
> > On Sat, Aug 31, 2013 at 11:25 AM, Lukáš Drbal <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Hi,
> > > i catch NPE when i try restore my snapshot.
> > >
> > > Snapshot is taken from online table and exported to another cluster
> via:
> > > hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot
> > > fb_posts-2013-08-31 -copy-to hdfs://hadoops-master:9000/hbase -chuser
> > hbase
> > > -chgroup hbase -mappers 14
> > >
> > >
> > > OT: files on hadoops-master cluster has permission hadoop:hbase (HDFS).
> > > Maybe a mistake? I specify -chuser and -chroup in export : ) I fix it
> > with
> > > hadoop fs -chown -R hbase:hbase /hbase
> > >
> > > hbase(main):006:0> list_snapshots
> > > SNAPSHOT
> >  TABLE
> > > + CREATION
> > > TIME
> > >
> > >  fb_comments-2013-08-27
> > > fb_comments (Tue Aug 27 08:42:01 +0000
> > > 2013)
> > >
> > >  fb_posts-2013-08-26
> > > fb_posts (Mon Aug 26 19:26:04 +0000
> > > 2013)
> > >
> > >  fb_posts-2013-08-31
> > > fb_posts (Sat Aug 31 17:22:52 +0000
> > > 2013)
> > >
> > > 3 row(s) in 0.0220 seconds
> > >
> > > SnapshotInfo: http://pastebin.com/dLS6tzTJ
> > >
> > > I see here a lot NOT_FOUND files, duno why and that's imho reason for
> > this
> > > fail.
> > >
> > > hbase(main):007:0> list
> > > TABLE
> > >
> > > fb_comments
> > >
> > > fb_posts
> > >
> > > fb_posts_old
> > >
> > > test
> > >
> > > 4 row(s) in 0.0180 seconds
> > >
> > > fb_posts_old are cloned snapshot from fb_posts-2013-08-26
> > >
> > > hbase(main):008:0> is_disabled 'fb_posts'
> > > true
> > >
> > > 0 row(s) in 0.0080 seconds
> > >
> > > hbase(main):009:0> restore_snapshot 'fb_posts-2013-08-31'
> > >
> > > output error: http://pastebin.com/tFsnGLha
> > >
> > > Master log: http://pastebin.com/yfLjJyfc
> > >
> > > RS logs are clean :( Log level are set to DEBUG
> > >
> > >
> > > Please excuse my bad english.
> > >
> > > --
> > > Save The World - http://www.worldcommunitygrid.org/
> > >
> http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
> > >
> > > LesTR
> > >
> >
>
>
>
> --
> Save The World - http://www.worldcommunitygrid.org/
> http://www.worldcommunitygrid.org/stat/viewMemberInfo.do?userName=LesTR
>
> LesTR
>
+
Lukáš Drbal 2013-09-03, 10:55