> Hello Lashing, > > MapReduce would be great : > > Each mapper addresses a different MySQL DB and "TableOutputFormat" to the > corresponding HTable. > > maybe pig : UNION after LOAD on different MySQL DB and then STORE on the > différent table according to your policy (may need several M/R jobs all > managed by pig workflow). > > The more efficient (1 job) would be pure home made Java MapReduce (mapper > only for each MySQL DB bulk loading on HTables) > > Cheers, > > -- > Damien HARDY
Hi Tariq, Thanks for the update. Can I run 1000 sqoop at the same time to one hbase ? Any contention may happen ? Thanks. Tariq <[EMAIL PROTECTED]> 於 2013/3/15 上午12:31 寫道：
> You might find Sqoop useful. > > Lashing <[EMAIL PROTECTED]> wrote: > >> Hi, >> I have many small MySQL DBs (more than 1000) that need to transfer data >> into multiple (10) tables in one single hbase cluster concurrently. >> What will be the best recommended approach ? Thanks. > > -- > Sent from my Android phone with K-9 Mail. Please excuse my brevity.