Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop to HDFS error Cannot initialize cluster


Copy link to this message
-
Re: Sqoop to HDFS error Cannot initialize cluster
Yay! I disabled oraOop and got clued to the final piece I think I was missing… -m1 since there is no primary key.

The final output:
$sqoop import --connect jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username sqoop --password xx --table SQOOP.TEST –m1

Successful
So it looks like in all I needed to:
-- Point Sqoop-env.xml to hadoop-0.20-mapreduce
-- Capitalize both owner and table name: SQOOP.TEST
-- Add –m1 at the end to make up for the lack of a primary key.

Thank-you again Abe for your guidance and help.

Cheers!
BC
From: Brenden Cobb <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Friday, January 31, 2014 3:41 PM
To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: Re: Sqoop to HDFS error Cannot initialize cluster

Hey-

I can run the list tables command without issue:
qoop list-tables --connect jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username sqoop --password sqoopWarning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
14/01/31 15:36:59 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
14/01/31 15:36:59 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
14/01/31 15:36:59 INFO manager.SqlManager: Using default fetchSize of 1000
14/01/31 15:37:00 INFO manager.OracleManager: Time zone has been set to GMT
TEST

I tried without the SQOOP owner prefix with the same result. Going back through the OraOop doc to make sure I did not miss something permissions related…

Perhaps found some clues here:
https://groups.google.com/a/cloudera.org/forum/#!topic/sqoop-user/RNWL62iHFpU

BC

From: Abraham Elmahrek <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Friday, January 31, 2014 3:00 PM
To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: Re: Sqoop to HDFS error Cannot initialize cluster

Awesome! Glad you're moving forward.

For your new exception. Have you verified the table you're trying to import is owned by the SQOOP user? Also, you may not need the "SQOOP." prefix in the table parameter.

-Abe
On Fri, Jan 31, 2014 at 10:57 AM, Brenden Cobb <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi Abe- thanks for your continued help on this issue. I changed my SQOOP env setting to point to .20 mapreduce and seem to have progressed (or stepped back?)

It appears I've moved beyond the Mapreduce error and into JDBC connector errors… Any thoughts are appreciated.
[$ sqoop import --connect jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username SQOOP --password xx --table SQOOP.test --verbose

14/01/31 13:50:01 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
14/01/31 13:50:01 DEBUG tool.BaseSqoopTool: Enabled debug logging.
14/01/31 13:50:01 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
14/01/31 13:50:01 DEBUG util.ClassLoaderStack: Checking for existing class: com.quest.oraoop.OraOopManagerFactory
14/01/31 13:50:01 DEBUG util.ClassLoaderStack: Class is already available. Skipping jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar
14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Added factory com.quest.oraoop.OraOopManagerFactory in jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar specified by /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/sqoop/conf/managers.d/oraoop
14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Loaded manager factory: com.quest.oraoop.OraOopManagerFactory
14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory
14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.quest.oraoop.OraOopManagerFactory
14/01/31 13:50:01 INFO manager.SqlManager: Using default fetchSize of 1000
14/01/31 13:50:02 INFO oraoop.OraOopManagerFactory:
***********************************************************************
*** Using Quest® Data Connector for Oracle and Hadoop 1.6.0-cdh4-20 ***
*** Copyright 2012 Quest Software, Inc.                             ***
*** ALL RIGHTS RESERVED.                                            ***
***********************************************************************
14/01/31 13:50:02 INFO oraoop.OraOopManagerFactory: Oracle Database version: Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
14/01/31 13:50:02 INFO oraoop.OraOopManagerFactory: This Oracle database is not a RAC.
14/01/31 13:50:02 DEBUG sqoop.ConnFactory: Instantiated ConnManager com.quest.oraoop.OraOopConnManager@40f892a4
14/01/31 13:50:02 INFO tool.CodeGenTool: Beginning code generation
14/01/31 13:50:02 DEBUG manager.SqlManager: Execute getColumnTypesRawQuery : SELECT "FIRST","LAST","EMAIL" FROM SQOOP.test WHERE 0=1
14/01/31 13:50:02 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
14/01/31 13:50:02 INFO manager.SqlManager: Executing SQL statement: SELECT "FIRST","LAST","EMAIL" FROM SQOOP.test WHERE 0=1
14/01/31 13:50:02 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
14/01/31 13:50:02 INFO manager.SqlManager: Executing SQL statement: SELECT FIRST,LAST,EMAIL FROM SQOOP.test WHERE 1=0
14/01/31 13:50:02 DEBUG orm.ClassWriter: selected columns:
14/01/31 13:50:02 DEBUG orm.ClassWriter:   FIRST
14/01/31 13:50:02 DEBUG orm.ClassWriter:   LAST
14/01/31 13:50:02 DEBUG orm.ClassWriter:   EMAIL
14/01/31 13:50:02 DEBUG orm.ClassWriter: Writing source file: /tmp/sqoop-oracle/compile/95f371afda8b0247e432776caf5d5f4a/SQOOP_test.java
14/01/31 13:50:02 DEBUG orm.ClassWriter: Table name: SQOOP.test
14/01