Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # dev >> Review Request 12269: SQOOP-1124: Direct export to PostgreSQL with PGBulkloadManager fails without explicit port number settings


Copy link to this message
-
Review Request 12269: SQOOP-1124: Direct export to PostgreSQL with PGBulkloadManager fails without explicit port number settings

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/12269/
-----------------------------------------------------------

Review request for Sqoop.
Bugs: SQOOP-1124
    https://issues.apache.org/jira/browse/SQOOP-1124
Repository: sqoop-trunk
Description
-------

Attached patch includes following changes:
1. handling for the case JdbcUrl.getPort returns -1 is added to PGBulkloadExportMapper,
2. settings for PGBulkloadManagerManualTest such as database, and username ,tablespace and path of pg_bulkload are made configurable via system property,
3. using not Configuration but JobConf in PGBulkloadManagerManualTest to follow changes in DBConfiguration.
Diffs
-----

  build.xml ef657e3
  src/java/org/apache/sqoop/manager/PGBulkloadManager.java 091fd15
  src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java cc60233
  src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java 81b1333
  src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java 6f55861
  src/test/com/cloudera/sqoop/manager/PGBulkloadManagerManualTest.java 0403614

Diff: https://reviews.apache.org/r/12269/diff/
Testing
-------

passed PGBulkloadManagerManualTest on PostgreSQL 9.2.4 and pg_bulkload 3.1.3.
Thanks,

Masatake Iwasaki

+
Masatake Iwasaki 2013-07-10, 05:51
+
Jarek Cecho 2013-07-10, 15:25