Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # dev - collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot


Copy link to this message
-
Re: collision in the naming of '.snapshot' directory between hdfs snapshot and hbase snapshot
Azuryy Yu 2013-04-16, 03:23
I think ".hbase-sanpshot" is good, but we should also disallow user to
create ".hbase-sanpshot" under hbase.root sub directories.
On Tue, Apr 16, 2013 at 11:18 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

> I plan to rename ".sanpshot" in HBase to ".hbase-sanpshot"
>
> Please suggest better name in future correspondence.
>
> Thanks
>
> On Mon, Apr 15, 2013 at 8:12 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > Lars:
> > I will go ahead and log an HBase JIRA, tomorrow morning.
> >
> > This hopefully would give people enough time to respond.
> >
> > Cheers
> >
> >
> > On Mon, Apr 15, 2013 at 8:00 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
> >
> >> OK. Let's try to fix that quickly, so that I can release HBase 0.94.7.
> >>
> >> -- Lars
> >>
> >>
> >>
> >> ________________________________
> >>  From: Ted Yu <[EMAIL PROTECTED]>
> >> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> >> Sent: Monday, April 15, 2013 7:13 PM
> >> Subject: collision in the naming of '.snapshot' directory between hdfs
> >> snapshot and hbase snapshot
> >>
> >>
> >> Hi,
> >> This afternoon Huned ad I discovered an issue while playing with HBase
> >> Snapshots on top of Hadoop's Snapshot branch (
> >> http://svn.apache.org/viewvc/hadoop/common/branches/HDFS-2802/).
> >>
> >> HDFS (built from HDFS-2802 branch) doesn't allow paths with .snapshot
> as a
> >> component while HBase tries to create paths with .snapshot as a
> component.
> >> This leads to issues in HBase, and one of HDFS or HBase needs to give up
> >> the .snapshot reserved keyword. HBase released Snapshots feature in
> 0.94.6
> >> (quite recently) and it may not be too late to change HBase to use a
> >> different path component in an upcoming new release.
> >>
> >> In HBase these path names are not user visible. If there is a deployment
> >> of
> >> 0.94.6, one could provide a migration tool that renames .snapshot to
> >> .hbase-snapshot or something to be able to move to the Snapshot release
> of
> >> Hadoop. On the other hand, .snapshot in HDFS is a user visible name and
> is
> >> a convention that is used by many file systems. It's a matter of
> >> familiarity with such path names that would help users in using HDFS
> >> snapshots.
> >>
> >> I am including the hdfs-dev in this email. Would appreciate if we could
> >> work together and come up with a solution.
> >>
> >> You can find sample output from hdfs command here:
> >> http://pastebin.com/bBqR4Fvr
> >>
> >> Cheers
> >>
> >
> >
>