Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop to HDFS error Cannot initialize cluster


Copy link to this message
-
Re: Sqoop to HDFS error Cannot initialize cluster
Here we go, thanks:

[oracle@som-dmsandbox03 ~]$ sqoop import --connect jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username sqoop --password xx --table sqoop.test --verbose
Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.
14/01/30 18:51:26 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
14/01/30 18:51:26 DEBUG tool.BaseSqoopTool: Enabled debug logging.
14/01/30 18:51:26 DEBUG util.ClassLoaderStack: Checking for existing class: com.quest.oraoop.OraOopManagerFactory
14/01/30 18:51:26 DEBUG util.ClassLoaderStack: Class is already available. Skipping jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar
14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Added factory com.quest.oraoop.OraOopManagerFactory in jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar specified by /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/sqoop/conf/managers.d/oraoop
14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Loaded manager factory: com.quest.oraoop.OraOopManagerFactory
14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory
14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.quest.oraoop.OraOopManagerFactory
14/01/30 18:51:26 INFO manager.SqlManager: Using default fetchSize of 1000
14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory:
***********************************************************************
*** Using Quest® Data Connector for Oracle and Hadoop 1.6.0-cdh4-20 ***
*** Copyright 2012 Quest Software, Inc.                             ***
*** ALL RIGHTS RESERVED.                                            ***
***********************************************************************
14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory: Oracle Database version: Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory: This Oracle database is not a RAC.
14/01/30 18:51:28 WARN conf.Configuration: mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
14/01/30 18:51:28 DEBUG sqoop.ConnFactory: Instantiated ConnManager com.quest.oraoop.OraOopConnManager@5a20f443
14/01/30 18:51:28 INFO tool.CodeGenTool: Beginning code generation
14/01/30 18:51:28 DEBUG manager.SqlManager: Execute getColumnTypesRawQuery : SELECT "FIRST","LAST","EMAIL" FROM sqoop.test WHERE 0=1
14/01/30 18:51:28 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
14/01/30 18:51:28 INFO manager.SqlManager: Executing SQL statement: SELECT "FIRST","LAST","EMAIL" FROM sqoop.test WHERE 0=1
14/01/30 18:51:28 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
14/01/30 18:51:28 INFO manager.SqlManager: Executing SQL statement: SELECT FIRST,LAST,EMAIL FROM sqoop.test WHERE 1=0
14/01/30 18:51:28 DEBUG orm.ClassWriter: selected columns:
14/01/30 18:51:28 DEBUG orm.ClassWriter:   FIRST
14/01/30 18:51:28 DEBUG orm.ClassWriter:   LAST
14/01/30 18:51:28 DEBUG orm.ClassWriter:   EMAIL
14/01/30 18:51:28 DEBUG orm.ClassWriter: Writing source file: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java
14/01/30 18:51:28 DEBUG orm.ClassWriter: Table name: sqoop.test
14/01/30 18:51:28 DEBUG orm.ClassWriter: Columns: FIRST:12, LAST:12, EMAIL:12,
14/01/30 18:51:28 DEBUG orm.ClassWriter: sourceFilename is sqoop_test.java
14/01/30 18:51:28 DEBUG orm.CompilationManager: Found existing /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/
14/01/30 18:51:28 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce
14/01/30 18:51:28 INFO orm.CompilationManager: Found hadoop core jar at: /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar
14/01/30 18:51:28 DEBUG orm.CompilationManager: Adding source file: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java
14/01/30 18:51:28 DEBUG orm.CompilationManager: Invoking javac with args:
14/01/30 18:51:28 DEBUG orm.CompilationManager:   -sourcepath
14/01/30 18:51:28 DEBUG orm.CompilationManager:   /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/
14/01/30 18:51:28 DEBUG orm.CompilationManager:   -d
14/01/30 18:51:28 DEBUG orm.CompilationManager:   /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/
14/01/30 18:51:28 DEBUG orm.CompilationManager:   -classpath
Note: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
14/01/30 18:51:30 DEBUG orm.CompilationManager: Could not rename /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java to /usr/local/oracle/./sqoop_test.java

......jars output removed for brevity......

org.apache.commons.io.FileExistsException: Destination '/usr/local/oracle/./sqoop_test.java' already exists
at org.apache.commons.io.FileUtils.moveFile(FileUtils.java:2378)
at org.apache.sqoop.orm.CompilationManager.compile(CompilationManager.java:229)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:97)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:396)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:222)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:231)
at org.apache.sqoop.Sqoop.main(Sqoop.java:240)
14/01/30 18:51:30 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop.test.jar
14/01/30 18:51:30 DEBUG orm.CompilationManager: Scanning for .class files in directory: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b
14/01/30 18:51:30 DEBUG orm.CompilationManager: Got classfile: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.class -> sqoop_test.class
14/01/30 18:51:30 DEBUG orm.