Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # dev >> Review Request 14240: SQOOP-1032: Add the --bulk-load-dir option to support the HBase doBulkLoad function


Copy link to this message
-
Re: Review Request 14240: SQOOP-1032: Add the --bulk-load-dir option to support the HBase doBulkLoad function

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14240/
-----------------------------------------------------------

(Updated Sept. 28, 2013, 12:35 a.m.)
Review request for Sqoop, Jarek Cecho and vasanthkumar.
Changes
-------

I realized that the bulk load directory is left as a remain after the sqoop job completes. Since the presence of the directory makes the sqoop job fail and it's created by sqoop, it makes sense to clean up at the end of the job so I added that as the last step.
Repository: sqoop-trunk
Description
-------

This is the patch to address some of the comments on Zhancheng Deng's review request (https://reviews.apache.org/r/13052/) which was basically the change to add the --bulk-load-dir option to support the HBase doBulkLoad function.
Diffs (updated)
-----

  src/java/org/apache/sqoop/SqoopOptions.java 01805f9
  src/java/org/apache/sqoop/hbase/HBasePutProcessor.java 9ceb5bd
  src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java 5ccf311
  src/java/org/apache/sqoop/manager/SqlManager.java 2a4992d
  src/java/org/apache/sqoop/mapreduce/HBaseBulkImportJob.java PRE-CREATION
  src/java/org/apache/sqoop/mapreduce/HBaseBulkImportMapper.java PRE-CREATION
  src/java/org/apache/sqoop/tool/BaseSqoopTool.java ebb1857

Diff: https://reviews.apache.org/r/14240/diff/
Testing
-------
Thanks,

Alexandre Normand