Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - mysql to hbase, how to custom row-family?


Copy link to this message
-
Re: mysql to hbase, how to custom row-family?
Jarek Jarcec Cecho 2013-05-20, 14:10
Hi Robber,
Sqoop currently supports importing only into single column family. You can import data twice using two different column families in each case and parameter --columns to filter only relevant columns for given column family.

Jarcec

On Mon, May 20, 2013 at 09:42:14PM +0800, Robber Phex wrote:
> I have a table in mysql like this:
> +-------+-------------+------+-----+---------+-------+
> | Field | Type        | Null | Key | Default | Extra |
> +-------+-------------+------+-----+---------+-------+
> | id    | int(11)     | NO   | PRI | NULL    |       |
> | name  | varchar(45) | YES  |     | NULL    |       |
> | age   | int(11)     | YES  |     | NULL    |       |
> | email | varchar(20) | YES  |     | NULL    |       |
> | title | varchar(10) | YES  |     | NULL    |       |
> +-------+-------------+------+-----+---------+-------+
> I want to export it to hbase by sqoop.
> I execute this:
> sqoop import --connect jdbc:mysql://h2/test --username testu --password
> testp \
>   --table testtable --hbase-create-table --hbase-table hbasetable \
>   --column-family name --column-family age --column-family email
> --column-family title \
>   --hbase-row-key id
>
> I get full data in hbase, but I want custom row-family. Exactly I need
> transformation like this:
>
> HBase                       MySQL Columns
>
> row key    <-----------     id
> baseinfo   <-----------     name
>                  `-<---     age
> workinfo   <-----------     email
>                  `-<---     title
>
> Anyone have any idea?
>
> --
> Regards,
> RobberPhex
>
> About me: http://about.me/RobberPhex