Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Sqoop 1.99.2 + Cloud Era Hadoop 200 error

Madhanmohan Savadamuthu 2013-07-02, 17:05
Mengwei Ding 2013-07-02, 17:20
Madhanmohan Savadamuthu 2013-07-03, 04:19
Mengwei Ding 2013-07-03, 14:00
Madhanmohan Savadamuthu 2013-07-03, 16:18
Copy link to this message
Re: Sqoop 1.99.2 + Cloud Era Hadoop 200 error
Thank you for your prompt response, sir. Please don't worry, I can help you
out with this until your problem is done.

Well, let's try out our new method of adding dependency jar files, and
forget about the addtowar.sh script.

Please following these instructions:

Installing Dependencies

Hadoop libraries must be available on node where you are planning to run
Sqoop server with proper configuration for major services - NameNode and
either JobTracker or ResourceManager depending whether you are running
Hadoop 1 or 2. There is no need to run any Hadoop service on the same node
as Sqoop server, just the libraries and configuration must be available.

Path to Hadoop libraries is stored in file catalina.properties inside
directory server/conf. You need to change property called common.loader to
contain all directories with your Hadoop libraries. The default expected
locations are /usr/lib/hadoop and /usr/lib/hadoop/lib/. Please check out
the comments in the file for further description how to configure different

Lastly you might need to install JDBC drivers that are not bundled with
Sqoop because of incompatible licenses. You can add any arbitrary Java jar
file to Sqoop server by copying it into lib/ directory. You can create this
directory if it do not exists already.

I can give you my configuration as an example. So in my catalina.properties
file, I have the following line:


The */usr/lib/hadoop/client-0.20/*.jar *is used to include all
hadoop-related jars, and *mysql-connector-java-5.1.25-bin.jar *is used for
JDBC driver.

Please try this, and let me know whether it works. Thank you.

On Wed, Jul 3, 2013 at 9:18 AM, Madhanmohan Savadamuthu

> I did deployment as sugggested in below thread. I am not able to
> successfully use sqoop2. I am attaching the services log for your
> references.
> I made sure that exact same set of JAR files in appropriate location and
> also deleted sqoop folder before starting the sqoop server.
> *Error Message:*
> Exception has occurred during processing command
> Exception: com.sun.jersey.api.client.UniformInterfaceException Message:
> GET http://<ipaddress>:12013/sqoop/version returned a response status of
> 404 Not Found
> Regards,
> Madhan
> On Wed, Jul 3, 2013 at 7:30 PM, Mengwei Ding <[EMAIL PROTECTED]>wrote:
>> Hi Madhanmohan,
>> Thank you for providing all these detailed information. Help a lot to
>> diagnose the problem.
>> First, the addtowar.sh is not good enough for every situation,
>> we apologize for that. We have already figured out a new way to add
>> dependency library, which will coming out along with next version of Sqoop2.
>> Currently, it seems like the hadoop-core.jar has not been added. I could
>> show you all the libraries existing in the webapps/sqoop/WEB-INF/lib
>> folder, please check below:
>>  avro-1.7.4.jar
>>  commons-cli-1.2.jar
>> commons-configuration-1.6.jar
>> commons-dbcp-1.4.jar
>> commons-lang-2.5.jar
>> commons-logging-1.1.1.jar
>> commons-pool-1.5.4.jar
>> derby-
>> guava-11.0.2.jar
>> hadoop-auth-2.0.0-cdh4.3.0.jar
>> hadoop-common-2.0.0-cdh4.3.0.jar
>> *hadoop-core-2.0.0-mr1-cdh4.3.0.jar*
>> hadoop-hdfs-2.0.0-cdh4.3.0.jar
>> hadoop-mapreduce-client-app-2.0.0-cdh4.3.0.jar
>> hadoop-mapreduce-client-common-2.0.0-cdh4.3.0.jar
>> hadoop-mapreduce-client-core-2.0.0-cdh4.3.0.jar
>> hadoop-mapreduce-client-jobclient-2.0.0-cdh4.3.0.jar
>> hadoop-yarn-api-2.0.0-cdh4.3.0.jar
>> hadoop-yarn-common-2.0.0-cdh4.3.0.jar
>>  jackson-core-asl-1.8.8.jar
>> jackson-mapper-asl-1.8.8.jar
>> json-simple-1.1.jar
>> log4j-1.2.16.jar
>> mysql-connector-java-5.1.25-bin.jar
>> protobuf-java-2.4.0a.jar
>> slf4j-api-1.6.1.jar
>> slf4j-log4j12-1.6.1.jar
Madhanmohan Savadamuthu 2013-07-04, 08:15
Mengwei Ding 2013-07-04, 17:38
Madhanmohan Savadamuthu 2013-07-05, 18:42
Mengwei Ding 2013-07-05, 19:04
Madhanmohan Savadamuthu 2013-07-09, 13:56
Jarek Jarcec Cecho 2013-07-09, 15:16
Madhanmohan Savadamuthu 2013-07-09, 15:54
Mengwei Ding 2013-07-12, 00:53
Madhanmohan Savadamuthu 2013-07-16, 17:13
Jarek Jarcec Cecho 2013-07-16, 17:51
Abraham Elmahrek 2013-07-02, 17:23
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB