Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop to HDFS error Cannot initialize cluster


Copy link to this message
-
Re: Sqoop to HDFS error Cannot initialize cluster
It looks like you're using a newer version of Hadoop that requires the
mapreduce.jobtracker.address property to be set. You can likely use the
same value as what you've provided for mapred.job.tracker.

-Abe
On Thu, Jan 30, 2014 at 3:58 PM, Brenden Cobb <[EMAIL PROTECTED]>wrote:

>  Here we go, thanks:
>
>  [oracle@som-dmsandbox03 ~]$ sqoop import --connect
> jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username
> sqoop --password xx --table sqoop.test --verbose
> Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.
> 14/01/30 18:51:26 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
> 14/01/30 18:51:26 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> 14/01/30 18:51:26 DEBUG util.ClassLoaderStack: Checking for existing
> class: com.quest.oraoop.OraOopManagerFactory
> 14/01/30 18:51:26 DEBUG util.ClassLoaderStack: Class is already available.
> Skipping jar /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar
> 14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Added factory
> com.quest.oraoop.OraOopManagerFactory in jar
> /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar specified by
> /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/sqoop/conf/managers.d/oraoop
> 14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.quest.oraoop.OraOopManagerFactory
> 14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.cloudera.sqoop.manager.DefaultManagerFactory
> 14/01/30 18:51:26 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> com.quest.oraoop.OraOopManagerFactory
> 14/01/30 18:51:26 INFO manager.SqlManager: Using default fetchSize of 1000
> 14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory:
> ***********************************************************************
> *** Using Quest(R) Data Connector for Oracle and Hadoop 1.6.0-cdh4-20 ***
> *** Copyright 2012 Quest Software, Inc.                             ***
> *** ALL RIGHTS RESERVED.                                            ***
> ***********************************************************************
> 14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory: Oracle Database
> version: Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit
> Production
> 14/01/30 18:51:28 INFO oraoop.OraOopManagerFactory: This Oracle database
> is not a RAC.
> 14/01/30 18:51:28 WARN conf.Configuration: mapred.map.max.attempts is
> deprecated. Instead, use mapreduce.map.maxattempts
> 14/01/30 18:51:28 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> com.quest.oraoop.OraOopConnManager@5a20f443
> 14/01/30 18:51:28 INFO tool.CodeGenTool: Beginning code generation
> 14/01/30 18:51:28 DEBUG manager.SqlManager: Execute getColumnTypesRawQuery
> : SELECT "FIRST","LAST","EMAIL" FROM sqoop.test WHERE 0=1
> 14/01/30 18:51:28 DEBUG manager.SqlManager: Using fetchSize for next
> query: 1000
> 14/01/30 18:51:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> "FIRST","LAST","EMAIL" FROM sqoop.test WHERE 0=1
> 14/01/30 18:51:28 DEBUG manager.SqlManager: Using fetchSize for next
> query: 1000
> 14/01/30 18:51:28 INFO manager.SqlManager: Executing SQL statement: SELECT
> FIRST,LAST,EMAIL FROM sqoop.test WHERE 1=0
> 14/01/30 18:51:28 DEBUG orm.ClassWriter: selected columns:
> 14/01/30 18:51:28 DEBUG orm.ClassWriter:   FIRST
> 14/01/30 18:51:28 DEBUG orm.ClassWriter:   LAST
> 14/01/30 18:51:28 DEBUG orm.ClassWriter:   EMAIL
> 14/01/30 18:51:28 DEBUG orm.ClassWriter: Writing source file:
> /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/sqoop_test.java
> 14/01/30 18:51:28 DEBUG orm.ClassWriter: Table name: sqoop.test
> 14/01/30 18:51:28 DEBUG orm.ClassWriter: Columns: FIRST:12, LAST:12,
> EMAIL:12,
> 14/01/30 18:51:28 DEBUG orm.ClassWriter: sourceFilename is sqoop_test.java
> 14/01/30 18:51:28 DEBUG orm.CompilationManager: Found existing
> /tmp/sqoop-oracle/compile/e3be71c52b86d50ad8177d621099250b/
> 14/01/30 18:51:28 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
> /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB