Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Change data capture tool for hbase


Copy link to this message
-
Re: Change data capture tool for hbase
Hello,

I have presented 5 CDC approaches based on HBase and published my results
in adbis 2013.

regards!

Yong
On Mon, Jun 3, 2013 at 11:16 AM, yavuz gokirmak <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> Currently we are working on a hbase change data capture (CDC) tool. I want
> to share our ideas and continue development according to your feedback.
>
> As you know CDC tools are used for tracking the data changes and take
> actions according to these changes[1].  For example in relational
> databases, CDC tools are mainly used for replication. You can replicate
> your source system continuously to another location or db using CDC tool.So
> whenever an insert/update/delete is done on the source system, you can
> reflect the same operation to the replicated environment.
>
> As I've said, we are working on a CDC tool that can track changes on a
> hbase table and reflect those changes to any other system in real-time.
>
> What we are trying to implement the tool in a way that he will behave as a
> slave cluster. So if we enable master-master replication in the source
> system, we expect to get all changes and act accordingly. Once the proof of
> concept cdc tool is implemented ( we need one week ) we will convert it to
> a flume source. So using it as a flume source we can direct data changes to
> any destination (sink)
>
> This is just a summary.
> Please write your feedback and comments.
>
> Do you know any tool similar to this proposal?
>
> regards.
>
>
>
>
>
> 1- http://en.wikipedia.org/wiki/Change_data_capture
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB