Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> CopyTable


+
Patrick Schless 2013-06-17, 19:20
+
Ted Yu 2013-06-17, 20:13
+
Patrick Schless 2013-06-17, 20:21
+
Patrick Schless 2013-06-19, 17:19
+
Matteo Bertozzi 2013-06-19, 17:24
+
Patrick Schless 2013-06-20, 22:39
+
lars hofhansl 2013-06-20, 22:48
Copy link to this message
-
Re: CopyTable
Did you guys thought about adding coprocessors hooks to the replication,
like preReplicateLogEntries, or something like that? I mean, in his case,
perhaps utilizing it could have changed the table name before running
through the replication process at the sink RS.

On Fri, Jun 21, 2013 at 1:48 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> I added that, but again only in 0.94 :(
>
>
>
> ----- Original Message -----
> From: Patrick Schless <[EMAIL PROTECTED]>
> To: user <[EMAIL PROTECTED]>
> Cc:
> Sent: Thursday, June 20, 2013 3:39 PM
> Subject: Re: CopyTable
>
> In my case, I can't disable the table, but I can pause updates (for long
> enough to switch to an identical-but-renamed table).
>
> The CopyTable job runs well, and subsequent runs (after the first) run very
> quickly (under a minute). The problem is that it doesn't include deletes
> (the "all.cells" option listed in the docs isn't available in 0.92). Is
> there any other way to get incremental backups, including deletes?
>
>
> On Wed, Jun 19, 2013 at 12:24 PM, Matteo Bertozzi
> <[EMAIL PROTECTED]>wrote:
>
> > On 0.92 you can use the latest rename script posted on the HBASE-7896
> jira.
> > note that in this case you've to disable your table first.
> >
> >
> > Matteo
> >
> >
> >
> > On Wed, Jun 19, 2013 at 6:19 PM, Patrick Schless
> > <[EMAIL PROTECTED]>wrote:
> >
> > > Unfortunately, I'm on 0.92.1, and the snapshot approach you linked
> isn't
> > > available until 0.94. Bummer, looked cool.
> > >
> > > Anybody have any insight into the question around the CopyTable
> process?
> > Or
> > > know another way to rename a table in 0.92.1?
> > >
> > > Thanks,
> > > Patrick
> > >
> > >
> > > On Mon, Jun 17, 2013 at 3:21 PM, Patrick Schless
> > > <[EMAIL PROTECTED]>wrote:
> > >
> > > > Sweet, I'll give that a try (I hadn't seen that before), thanks.
> > > >
> > > > If it's not super fast (under a few minutes), I'll still have to go
> > with
> > > > the CopyTable approach, though. I'm currently testing, but my
> > assumption
> > > is
> > > > that I can do a series of CopyTables (all but the first CopyTable
> would
> > > > specify a starttime of when the previous job began) will end up with
> > > only a
> > > > small period of downtime (the final CopyTable).
> > > >
> > > >
> > > > On Mon, Jun 17, 2013 at 3:13 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > > >
> > > >> bq.  since there doesn't seem to be a good way to rename a table
> > > >>
> > > >> Have you looked at http://hbase.apache.org/book.html#table.rename ?
> > > >>
> > > >> Cheers
> > > >>
> > > >> On Mon, Jun 17, 2013 at 12:20 PM, Patrick Schless <
> > > >> [EMAIL PROTECTED]
> > > >> > wrote:
> > > >>
> > > >> > Context:
> > > >> > I'm working on getting replication set up, and a prerequisite for
> me
> > > is
> > > >> to
> > > >> > rename the table (since you have to replicate to the same name as
> > the
> > > >> > source). For this, I'm testing a CopyTable strategy, since there
> > > doesn't
> > > >> > seem to be a good way to rename a table (please correct me if I'm
> > > >> wrong).
> > > >> >
> > > >> > My question:
> > > >> > According to [1], the CopyTable job takes an argument "all.cells"
> > > which
> > > >> > "Also
> > > >> > copy delete markers and uncollected deleted cells (advanced
> > option)."
> > > >> >
> > > >> > I'm confused by the "advanced option" bit. When would you not want
> > to
> > > >> copy
> > > >> > deletes over to a new table? Without that, it seems like you could
> > end
> > > >> up
> > > >> > with more data than you were expecting in the target table.
> > > >> >
> > > >> > Any info would be helpful.
> > > >> >
> > > >> > Thanks,
> > > >> > Patrick
> > > >> >
> > > >> >
> > > >> > [1] http://hbase.apache.org/book/ops_mgt.html#copytable
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB