Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - ETL like merge databases to HBase


+
Shengjie Min 2013-08-01, 15:04
+
Ted Yu 2013-08-01, 16:13
+
Shengjie Min 2013-08-02, 01:23
+
Ted Yu 2013-08-02, 01:27
+
Jay Vyas 2013-08-02, 02:17
Copy link to this message
-
Re: ETL like merge databases to HBase
Shahab Yunus 2013-08-02, 03:07
Though it is better as Ted suggested to discuss this in Sqoop mailing list
(as Sqoop 2 supposed to be more feature rich) but just to get this out,
Sqoop does support incremental imports if you can come up with a suitable
and compatible strategy. Tha tmigh thelp you if you configure you imports
on some periodic schedule.

Regards,
Shahab
On Thu, Aug 1, 2013 at 10:17 PM, Jay Vyas <[EMAIL PROTECTED]> wrote:

> Hbase doesn't have dynamic views on data outside of itself. But you can
> easily re run your sqoop flow to dump information into hbase.
>
> Actually, it might be easier to go with a pure RDBMS solution here since
> nowadays the Slave/master architectures in postgre and MySQL are mature
> enough to handle this sort of thing even for hundreds of thousands of rows.
+
shengjie min 2013-08-03, 20:03
+
shengjie min 2013-08-05, 00:54
+
manishbhoge@...) 2013-08-05, 02:30