Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop to HDFS error Cannot initialize cluster


Copy link to this message
-
Re: Sqoop to HDFS error Cannot initialize cluster
Hi Abe- thanks for your continued help on this issue. I changed my SQOOP env setting to point to .20 mapreduce and seem to have progressed (or stepped back?)

It appears I've moved beyond the Mapreduce error and into JDBC connector errors… Any thoughts are appreciated.
[$ sqoop import --connect jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username SQOOP --password xx --table SQOOP.test --verbose

14/01/31 13:50:01 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
14/01/31 13:50:01 DEBUG tool.BaseSqoopTool: Enabled debug logging.
14/01/31 13:50:01 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
14/01/31 13:50:01 DEBUG util.ClassLoaderStack: Checking for existing class: com.quest.oraoop.OraOopManagerFactory
14/01/31 13:50:01 DEBUG util.ClassLoaderStack: Class is already available. Skipping jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar
14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Added factory com.quest.oraoop.OraOopManagerFactory in jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar specified by /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/sqoop/conf/managers.d/oraoop
14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Loaded manager factory: com.quest.oraoop.OraOopManagerFactory
14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory
14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.quest.oraoop.OraOopManagerFactory
14/01/31 13:50:01 INFO manager.SqlManager: Using default fetchSize of 1000
14/01/31 13:50:02 INFO oraoop.OraOopManagerFactory:
***********************************************************************
*** Using Quest® Data Connector for Oracle and Hadoop 1.6.0-cdh4-20 ***
*** Copyright 2012 Quest Software, Inc.                             ***
*** ALL RIGHTS RESERVED.                                            ***
***********************************************************************
14/01/31 13:50:02 INFO oraoop.OraOopManagerFactory: Oracle Database version: Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
14/01/31 13:50:02 INFO oraoop.OraOopManagerFactory: This Oracle database is not a RAC.
14/01/31 13:50:02 DEBUG sqoop.ConnFactory: Instantiated ConnManager com.quest.oraoop.OraOopConnManager@40f892a4
14/01/31 13:50:02 INFO tool.CodeGenTool: Beginning code generation
14/01/31 13:50:02 DEBUG manager.SqlManager: Execute getColumnTypesRawQuery : SELECT "FIRST","LAST","EMAIL" FROM SQOOP.test WHERE 0=1
14/01/31 13:50:02 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
14/01/31 13:50:02 INFO manager.SqlManager: Executing SQL statement: SELECT "FIRST","LAST","EMAIL" FROM SQOOP.test WHERE 0=1
14/01/31 13:50:02 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
14/01/31 13:50:02 INFO manager.SqlManager: Executing SQL statement: SELECT FIRST,LAST,EMAIL FROM SQOOP.test WHERE 1=0
14/01/31 13:50:02 DEBUG orm.ClassWriter: selected columns:
14/01/31 13:50:02 DEBUG orm.ClassWriter:   FIRST
14/01/31 13:50:02 DEBUG orm.ClassWriter:   LAST
14/01/31 13:50:02 DEBUG orm.ClassWriter:   EMAIL
14/01/31 13:50:02 DEBUG orm.ClassWriter: Writing source file: /tmp/sqoop-oracle/compile/95f371afda8b0247e432776caf5d5f4a/SQOOP_test.java
14/01/31 13:50:02 DEBUG orm.ClassWriter: Table name: SQOOP.test
14/01/31 13:50:02 DEBUG orm.ClassWriter: Columns: FIRST:12, LAST:12, EMAIL:12,
14/01/31 13:50:02 DEBUG orm.ClassWriter: sourceFilename is SQOOP_test.java
14/01/31 13:50:02 DEBUG orm.CompilationManager: Found existing /tmp/sqoop-oracle/compile/95f371afda8b0247e432776caf5d5f4a/
14/01/31 13:50:02 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce
14/01/31 13:50:02 INFO orm.CompilationManager: Found hadoop core jar at: /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/hadoop-core.jar
14/01/31 13:50:02 DEBUG orm.CompilationManager: Adding source file: /tmp/sqoop-oracle/compile/95f371afda8b0247e432776caf5d5f4a/SQOOP_test.java
14/01/31 13:50:02 DEBUG orm.CompilationManager: Invoking javac with args:
14/01/31 13:50:02 DEBUG orm.CompilationManager:   -sourcepath
14/01/31 13:50:02 DEBUG orm.CompilationManager:   /tmp/sqoop-oracle/compile/95f371afda8b0247e432776caf5d5f4a/
14/01/31 13:50:02 DEBUG orm.CompilationManager:   -d
14/01/31 13:50:02 DEBUG orm.CompilationManager:   /tmp/sqoop-oracle/compile/95f371afda8b0247e432776caf5d5f4a/
14/01/31 13:50:02 DEBUG orm.CompilationManager:   -classpath
14/01/31 13:50:02 DEBUG orm.CompilationManager:   /etc/hadoop/conf:/opt/cloudera/parcels/CDH/lib/hadoop/lib/jersey-json-1.8.
Note: /tmp/sqoop-oracle/compile/95f371afda8b0247e432776caf5d5f4a/SQOOP_test.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
14/01/31 13:50:03 DEBUG orm.CompilationManager: Could not rename /tmp/sqoop-oracle/compile/95f371afda8b0247e432776caf5d5f4a/SQOOP_test.java to /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/etc/sqoop/conf.dist/./SQOOP_test.java
java.io.FileNotFoundException: /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/etc/sqoop/conf.dist/./SQOOP_test.java (Permission denied)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
at org.apache.commons.io.FileUtils.doCopyFile(FileUtils.java:936)
at org.apache.commons.io.FileUtils.copyFile(FileUtils.java:888)
at org.apache.commons.io.FileUtils.copyFile(FileUtils.java:835)
at org.apache.commons.io.FileUtils.moveFile(FileUtils.java:2385)
at org.apache.sqoop.orm.CompilationManager.compile(CompilationManager.java:229)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:97)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:396)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRun
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB