Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> ETL like merge databases to HBase


Copy link to this message
-
Re: ETL like merge databases to HBase
Thanks  v much guys. Indeed, I've seen more rich features covered in sqoop2, the integration with oozie sounds v cool as well. will try to ask this in sqoop mailing list again :)

Cheers!
Shengjie

On 2 Aug 2013, at 11:07, Shahab Yunus <[EMAIL PROTECTED]> wrote:

> Though it is better as Ted suggested to discuss this in Sqoop mailing list
> (as Sqoop 2 supposed to be more feature rich) but just to get this out,
> Sqoop does support incremental imports if you can come up with a suitable
> and compatible strategy. Tha tmigh thelp you if you configure you imports
> on some periodic schedule.
>
> Regards,
> Shahab
>
>
> On Thu, Aug 1, 2013 at 10:17 PM, Jay Vyas <[EMAIL PROTECTED]> wrote:
>
>> Hbase doesn't have dynamic views on data outside of itself. But you can
>> easily re run your sqoop flow to dump information into hbase.
>>
>> Actually, it might be easier to go with a pure RDBMS solution here since
>> nowadays the Slave/master architectures in postgre and MySQL are mature
>> enough to handle this sort of thing even for hundreds of thousands of rows.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB