Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # dev - Review Request 14240: SQOOP-1032: Add the --bulk-load-dir option to support the HBase doBulkLoad function


Copy link to this message
-
Re: Review Request 14240: SQOOP-1032: Add the --bulk-load-dir option to support the HBase doBulkLoad function
Alexandre Normand 2013-09-27, 23:01

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14240/
-----------------------------------------------------------

(Updated Sept. 27, 2013, 11:01 p.m.)
Review request for Sqoop, Jarek Cecho and vasanthkumar.
Changes
-------

There was a problem with the previous patch since hfiles are generated with the user submitting the job as the owner. The files need to be accessible by the hbase user for the doBulkLoad to work.  
Repository: sqoop-trunk
Description
-------

This is the patch to address some of the comments on Zhancheng Deng's review request (https://reviews.apache.org/r/13052/) which was basically the change to add the --bulk-load-dir option to support the HBase doBulkLoad function.
Diffs (updated)
-----

  src/java/org/apache/sqoop/SqoopOptions.java 01805f9
  src/java/org/apache/sqoop/hbase/HBasePutProcessor.java 9ceb5bd
  src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java 5ccf311
  src/java/org/apache/sqoop/manager/SqlManager.java 2a4992d
  src/java/org/apache/sqoop/mapreduce/HBaseBulkImportJob.java PRE-CREATION
  src/java/org/apache/sqoop/mapreduce/HBaseBulkImportMapper.java PRE-CREATION
  src/java/org/apache/sqoop/tool/BaseSqoopTool.java ebb1857

Diff: https://reviews.apache.org/r/14240/diff/
Testing
-------
Thanks,

Alexandre Normand