Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop, mail # dev - Review Request: SQOOP-658 Solve hadoop dependency distribution/loading on server side


Copy link to this message
-
Review Request: SQOOP-658 Solve hadoop dependency distribution/loading on server side
Jarek Cecho 2012-11-04, 19:32

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/7860/
-----------------------------------------------------------

Review request for Sqoop.
Description
-------

I've ported Oozie's script for populating hadoop binaries to Oozie server to Sqoop (and Sqoop server). Basically user have to manually execute command ./bin/addtowar.sh to install hadoop binaries. Right now, only hadoop 2.0.0 is supported.
This addresses bug SQOOP-658.
    https://issues.apache.org/jira/browse/SQOOP-658
Diffs
-----

  dist/src/main/bin/addtowar.sh PRE-CREATION

Diff: https://reviews.apache.org/r/7860/diff/
Testing
-------

I've tested it on CDH 4.1.1 with following execution:

./bin/addtowar.sh -hadoop 2.0 /usr/lib/hadoop/client/ -jars /usr/lib/sqoop/lib/mysql-connector-java-5.1.21-bin.jar:/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.1.1.jar
* Base hadoop version is 2.0
* Adding MySQL JDBC driver to test MySQL data import
* Adding MR1 implementation that is specific to CDH
Thanks,

Jarek Cecho

+
Bilung Lee 2012-11-06, 20:46