Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> can we use -libjars with the Sqoop tool?


Copy link to this message
-
Re: can we use -libjars with the Sqoop tool?
sqoop tools  implement the ToolRunner interface.   So, you can pass
-libjars to sqoop (but make sure it is the first option among the list of
the options

For example, sqoop import -libjars $LIBJARS other options

Venkat
On Wed, Jun 5, 2013 at 5:23 PM, Jane Wayne <[EMAIL PROTECTED]> wrote:

> hi,
>
> i am wondering if i can run the org.apache.sqoop.Sqoop tool like other
> tools from the command line using the -libjars flag/option/parameter?
>
> i have tried the following.
>
> export
> LIBJARS=ant-contrib-1.0b3.jar,ant-eclipse-1.0-jvm1.2.jar,avro-1.5.3.jar,avro-ipc-1.5.3.jar,avro-mapred-1.5.3.jar,commons-io-1.4.jar,hsqldb-1.8.0.10.jar,ivy-2.1.0.jar,jackson-core-asl-1.7.3.jar,jackson-mapper-asl-1.7.3.jar,jopt-simple-3.2.jar,paranamer-2.3.jar,snappy-java-1.0.3.2.jar
>
> hadoop --config path/to/sqoop-cluster-config-dir jar sqoop-1.4.3.jar
> org.apache.sqoop.Sqoop -libjars ${LIBJARS} import --connect
> jdbc:mysql://mysql/mydb --username myuser --password mypass --table data
> --verbose --append --warehouse-dir /sqoop
>
> what i get is the message below.
>
> No such sqoop tool: -libjars. See 'sqoop help'.
>
> obviously, this problem has something to do with sqoop's parsing of the
> command line options. shouldn't sqoop allow hadoop's command line options
> and its own at the same time?
>
> in the meanwhile, i will try to tinker a bit with that Sqoop class to see
> if i can get it to work with -libjars.
>
> references that i found regarding -libjars.
> 1. http://grepalex.com/2013/02/25/hadoop-libjars/
> 2.
> http://blog.cloudera.com/blog/2011/01/how-to-include-third-party-libraries-in-your-map-reduce-job/
>
> thanks,
>