Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> can we use -libjars with the Sqoop tool?


Copy link to this message
-
can we use -libjars with the Sqoop tool?
hi,

i am wondering if i can run the org.apache.sqoop.Sqoop tool like other
tools from the command line using the -libjars flag/option/parameter?

i have tried the following.

export
LIBJARS=ant-contrib-1.0b3.jar,ant-eclipse-1.0-jvm1.2.jar,avro-1.5.3.jar,avro-ipc-1.5.3.jar,avro-mapred-1.5.3.jar,commons-io-1.4.jar,hsqldb-1.8.0.10.jar,ivy-2.1.0.jar,jackson-core-asl-1.7.3.jar,jackson-mapper-asl-1.7.3.jar,jopt-simple-3.2.jar,paranamer-2.3.jar,snappy-java-1.0.3.2.jar

hadoop --config path/to/sqoop-cluster-config-dir jar sqoop-1.4.3.jar
org.apache.sqoop.Sqoop -libjars ${LIBJARS} import --connect
jdbc:mysql://mysql/mydb --username myuser --password mypass --table data
--verbose --append --warehouse-dir /sqoop

what i get is the message below.

No such sqoop tool: -libjars. See 'sqoop help'.

obviously, this problem has something to do with sqoop's parsing of the
command line options. shouldn't sqoop allow hadoop's command line options
and its own at the same time?

in the meanwhile, i will try to tinker a bit with that Sqoop class to see
if i can get it to work with -libjars.

references that i found regarding -libjars.
1. http://grepalex.com/2013/02/25/hadoop-libjars/
2.
http://blog.cloudera.com/blog/2011/01/how-to-include-third-party-libraries-in-your-map-reduce-job/

thanks,
+
Venkat Ranganathan 2013-06-06, 05:54
+
Jane Wayne 2013-06-06, 12:56
+
Venkat Ranganathan 2013-06-06, 15:36
+
Jane Wayne 2013-06-06, 20:11
+
abhijeet gaikwad 2013-06-08, 05:05
+
Deepak Vohra 2013-06-06, 13:28
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB