Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop, mail # dev - Review Request: SQOOP-621: Requesting support for upsert export with MySQL


+
Jarek Cecho 2012-10-15, 00:52
+
Cheolsoo Park 2012-10-17, 18:01
+
Jarek Cecho 2012-10-17, 23:31
+
Jarek Cecho 2012-10-17, 23:33
Copy link to this message
-
Re: Review Request: SQOOP-621: Requesting support for upsert export with MySQL
Cheolsoo Park 2012-10-18, 03:27

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/7588/#review12555
-----------------------------------------------------------

Ship it!
Ship It!

- Cheolsoo Park
On Oct. 17, 2012, 11:33 p.m., Jarek Cecho wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/7588/
> -----------------------------------------------------------
>
> (Updated Oct. 17, 2012, 11:33 p.m.)
>
>
> Review request for Sqoop.
>
>
> Description
> -------
>
> I've implemented upsert functionality using MySQL clause INSERT INTO ... ON DUPLICATE KEY UPDATE. This clause have slightly different purpose than Oracle's MERGE statement and therefore the functionality is slightly different. I've provided warning message notifying user that column names specified in --update-key parameter are not going to be used.
>
>
> This addresses bug SQOOP-621.
>     https://issues.apache.org/jira/browse/SQOOP-621
>
>
> Diffs
> -----
>
>   src/docs/user/connectors.txt 930a4996e47a18a763bfbed59656cf8ea5cff05e
>   src/java/org/apache/sqoop/manager/DirectMySQLManager.java 2e8d63e5b45f0b74b0ccce9e9bff4a1f798bb6a8
>   src/java/org/apache/sqoop/manager/MySQLManager.java a817aa41fee3385b6e8796cadd4c09319b0b6e68
>   src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java c8e17c236f272387fd14ef6d222cc0edb5fe59ab
>   src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java PRE-CREATION
>   src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java f00cac4eb7c0600dc567717eff391909a831c6fb
>   src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java PRE-CREATION
>
> Diff: https://reviews.apache.org/r/7588/diff/
>
>
> Testing
> -------
>
> I've added new unit tests plus live testing.
>
>
> Thanks,
>
> Jarek Cecho
>
>