Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop 2 Oracle JDBC connector not visible / available


Copy link to this message
-
Re: Sqoop 2 Oracle JDBC connector not visible / available
Hi Chris,
I'm excited to see your interest in Sqoop2! I believe that you've done everything correctly and that the output is expected. The reason for that is the difference between "connector" and "driver". You might find more details about the difference in our blog [1]. The article is written for Sqoop 1, but the same concepts applies to Sqoop2. To make the story short - Connectors usually came with Sqoop and are the thing you can see after calling "show connector -a", JDBC Drivers are something that is required by the connectors in order to do the work and you have to install them manually (licensing issues). So in your case Sqoop 2 already came with a "Generic JDBC Connector" and you've just installed an Oracle "JDBC Driver".

Jarcec

Links:
1: https://blogs.apache.org/sqoop/entry/connectors_and_drivers_in_the

On Wed, Nov 13, 2013 at 01:04:13PM -0500, Christopher Jones wrote:
> Hi Sqoopers,
>
> I'm using Sqoop 2 and am trying to transfer some Oracle 11g tables to HDFS.
>  I believe I have the jar file where it's supposed to be:
>
> ]$ ls /var/lib/sqoop2/ojdbc6-11.2.0.3.jar
> /var/lib/sqoop2/ojdbc6-11.2.0.3.jar
>
> and it's a non-empty file.  I tried to make sure the jar was on the
> $CLASSPATH too:
>
> $ echo $CLASSPATH
> /etc/hadoop/conf:/usr/lib/hadoop/lib/*:/usr/lib/hadoop/.//*:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-hdfs/.//*:/usr/lib/hadoop-yarn/lib/*:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-0.20-mapreduce/./:/usr/lib/hadoop-0.20-mapreduce/lib/*:/usr/lib/hadoop-0.20-mapreduce/.//*:/var/lib/sqoop2/ojdbc6-11.2.0.3.jar
>
> However, when I run sqoop2 at the command line, I can only see the generic
> connector:
>
> $ sqoop2
> Sqoop home directory: /usr/lib/sqoop2
> Sqoop Shell: Type 'help' or '\h' for help.
>
> sqoop:000> show connector --all
> 1 connector(s) to show:
> Connector with id 1:
>   Name: generic-jdbc-connector
>  Class: org.apache.sqoop.connector.jdbc.GenericJdbcConnector
>   Version: 1.99.2-cdh4.4.0
>   Supported job types: [IMPORT, EXPORT]
> (...)
>
> Shouldn't I be seeing the Oracle connector as well?
>
> I'm using the following version:
>
> sqoop:000> show version
> client version:
>   Sqoop 1.99.2-cdh4.4.0 revision
>   Compiled by jenkins on Tue Sep  3 20:15:11 PDT 2013
>
> Thanks for your help, and for all the hard work,
> Chris