Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - CopyTable


+
Patrick Schless 2013-06-17, 19:20
+
Ted Yu 2013-06-17, 20:13
+
Patrick Schless 2013-06-17, 20:21
+
Patrick Schless 2013-06-19, 17:19
+
Matteo Bertozzi 2013-06-19, 17:24
+
Patrick Schless 2013-06-20, 22:39
+
lars hofhansl 2013-06-20, 22:48
Copy link to this message
-
Re: CopyTable
Asaf Mesika 2013-06-21, 05:34
Did you guys thought about adding coprocessors hooks to the replication,
like preReplicateLogEntries, or something like that? I mean, in his case,
perhaps utilizing it could have changed the table name before running
through the replication process at the sink RS.

On Fri, Jun 21, 2013 at 1:48 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> I added that, but again only in 0.94 :(
>
>
>
> ----- Original Message -----
> From: Patrick Schless <[EMAIL PROTECTED]>
> To: user <[EMAIL PROTECTED]>
> Cc:
> Sent: Thursday, June 20, 2013 3:39 PM
> Subject: Re: CopyTable
>
> In my case, I can't disable the table, but I can pause updates (for long
> enough to switch to an identical-but-renamed table).
>
> The CopyTable job runs well, and subsequent runs (after the first) run very
> quickly (under a minute). The problem is that it doesn't include deletes
> (the "all.cells" option listed in the docs isn't available in 0.92). Is
> there any other way to get incremental backups, including deletes?
>
>
> On Wed, Jun 19, 2013 at 12:24 PM, Matteo Bertozzi
> <[EMAIL PROTECTED]>wrote:
>
> > On 0.92 you can use the latest rename script posted on the HBASE-7896
> jira.
> > note that in this case you've to disable your table first.
> >
> >
> > Matteo
> >
> >
> >
> > On Wed, Jun 19, 2013 at 6:19 PM, Patrick Schless
> > <[EMAIL PROTECTED]>wrote:
> >
> > > Unfortunately, I'm on 0.92.1, and the snapshot approach you linked
> isn't
> > > available until 0.94. Bummer, looked cool.
> > >
> > > Anybody have any insight into the question around the CopyTable
> process?
> > Or
> > > know another way to rename a table in 0.92.1?
> > >
> > > Thanks,
> > > Patrick
> > >
> > >
> > > On Mon, Jun 17, 2013 at 3:21 PM, Patrick Schless
> > > <[EMAIL PROTECTED]>wrote:
> > >
> > > > Sweet, I'll give that a try (I hadn't seen that before), thanks.
> > > >
> > > > If it's not super fast (under a few minutes), I'll still have to go
> > with
> > > > the CopyTable approach, though. I'm currently testing, but my
> > assumption
> > > is
> > > > that I can do a series of CopyTables (all but the first CopyTable
> would
> > > > specify a starttime of when the previous job began) will end up with
> > > only a
> > > > small period of downtime (the final CopyTable).
> > > >
> > > >
> > > > On Mon, Jun 17, 2013 at 3:13 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > > >
> > > >> bq.  since there doesn't seem to be a good way to rename a table
> > > >>
> > > >> Have you looked at http://hbase.apache.org/book.html#table.rename ?
> > > >>
> > > >> Cheers
> > > >>
> > > >> On Mon, Jun 17, 2013 at 12:20 PM, Patrick Schless <
> > > >> [EMAIL PROTECTED]
> > > >> > wrote:
> > > >>
> > > >> > Context:
> > > >> > I'm working on getting replication set up, and a prerequisite for
> me
> > > is
> > > >> to
> > > >> > rename the table (since you have to replicate to the same name as
> > the
> > > >> > source). For this, I'm testing a CopyTable strategy, since there
> > > doesn't
> > > >> > seem to be a good way to rename a table (please correct me if I'm
> > > >> wrong).
> > > >> >
> > > >> > My question:
> > > >> > According to [1], the CopyTable job takes an argument "all.cells"
> > > which
> > > >> > "Also
> > > >> > copy delete markers and uncollected deleted cells (advanced
> > option)."
> > > >> >
> > > >> > I'm confused by the "advanced option" bit. When would you not want
> > to
> > > >> copy
> > > >> > deletes over to a new table? Without that, it seems like you could
> > end
> > > >> up
> > > >> > with more data than you were expecting in the target table.
> > > >> >
> > > >> > Any info would be helpful.
> > > >> >
> > > >> > Thanks,
> > > >> > Patrick
> > > >> >
> > > >> >
> > > >> > [1] http://hbase.apache.org/book/ops_mgt.html#copytable
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
>