Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop to HDFS error Cannot initialize cluster


Copy link to this message
-
Re: Sqoop to HDFS error Cannot initialize cluster
Here we go, thanks:

[oracle@som-dmsandbox03 ~]$ sqoop import --connect jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username sqoop --password xx --table sqoop.test --verbose
Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.
14/01/30 18:51:26 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
14/01/30 18:51:26 DEBUG tool.BaseSqoopTool: Enabled debug logging.
14/01/30 18:51:26 DEBUG util.ClassLoaderStack: Checking for existing class: com.quest.oraoop.OraOopManagerFactory
14/01/30 18:51:26 DEBUG util.ClassLoaderStack: Class is already available. Skipping jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar
14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Added factory com.quest.oraoop.OraOopManagerFactory in jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar specified by /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/sqoop/conf/managers.d/oraoop
14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Loaded manager factory: com.quest.oraoop.OraOopManagerFactory
14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory
14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.quest.oraoop.OraOopManagerFactory
14/01/30 18:51:26 INFO manager.SqlManager: Using default fetchSize of 1000
14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory:
***********************************************************************
*** Using Quest® Data Connector for Oracle and Hadoop 1.6.0-cdh4-20 ***
*** Copyright 2012 Quest Software, Inc.                             ***
*** ALL RIGHTS RESERVED.                                            ***
***********************************************************************
14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory: Oracle Database version: Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory: This Oracle database is not a RAC.
14/01/30 18:51:28 WARN conf.Configuration: mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
14/01/30 18:51:28 DEBUG sqoop.ConnFactory: Instantiated ConnManager com.quest.oraoop.OraOopConnManager@5a20f443
14/01/30 18:51:28 INFO tool.CodeGenTool: Beginning code generation
14/01/30 18:51:28 DEBUG manager.SqlManager: Execute getColumnTypesRawQuery : SELECT "FIRST","LAST","EMAIL" FROM sqoop.test WHERE 0=1
14/01/30 18:51:28 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
14/01/30 18:51:28 INFO manager.SqlManager: Executing SQL statement: SELECT "FIRST","LAST","EMAIL" FROM sqoop.test WHERE 0=1
14/01/30 18:51:28 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
14/01/30 18:51:28 INFO manager.SqlManager: Executing SQL statement: SELECT FIRST,LAST,EMAIL FROM sqoop.test WHERE 1=0
14/01/30 18:51:28 DEBUG orm.ClassWriter: selected columns:
14/01/30 18:51:28 DEBUG orm.ClassWriter:   FIRST
14/01/30 18:51:28 DEBUG orm.ClassWriter:   LAST
14/01/30 18:51:28 DEBUG orm.ClassWriter:   EMAIL
14/01/30 18:51:28 DEBUG orm.ClassWriter: Writing source file: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java
14/01/30 18:51:28 DEBUG orm.ClassWriter: Table name: sqoop.test
14/01/30 18:51:28 DEBUG orm.ClassWriter: Columns: FIRST:12, LAST:12, EMAIL:12,
14/01/30 18:51:28 DEBUG orm.ClassWriter: sourceFilename is sqoop_test.java
14/01/30 18:51:28 DEBUG orm.CompilationManager: Found existing /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/
14/01/30 18:51:28 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce
14/01/30 18:51:28 INFO orm.CompilationManager: Found hadoop core jar at: /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar
14/01/30 18:51:28 DEBUG orm.CompilationManager: Adding source file: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java
14/01/30 18:51:28 DEBUG orm.CompilationManager: Invoking javac with args:
14/01/30 18:51:28 DEBUG orm.CompilationManager:   -sourcepath
14/01/30 18:51:28 DEBUG orm.CompilationManager:   /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/
14/01/30 18:51:28 DEBUG orm.CompilationManager:   -d
14/01/30 18:51:28 DEBUG orm.CompilationManager:   /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/
14/01/30 18:51:28 DEBUG orm.CompilationManager:   -classpath
Note: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
14/01/30 18:51:30 DEBUG orm.CompilationManager: Could not rename /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java to /usr/local/oracle/./sqoop_test.java

......jars output removed for brevity......

org.apache.commons.io.FileExistsException: Destination '/usr/local/oracle/./sqoop_test.java' already exists
at org.apache.commons.io.FileUtils.moveFile(FileUtils.java:2378)
at org.apache.sqoop.orm.CompilationManager.compile(CompilationManager.java:229)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:97)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:396)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:222)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:231)
at org.apache.sqoop.Sqoop.main(Sqoop.java:240)
14/01/30 18:51:30 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop.test.jar
14/01/30 18:51:30 DEBUG orm.CompilationManager: Scanning for .class files in directory: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b
14/01/30 18:51:30 DEBUG orm.CompilationManager: Got classfile: /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.class -> sqoop_test.class
14/01/30 18:51:30 DEBUG orm.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB