Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Sqoop to HDFS error Cannot initialize cluster


Copy link to this message
-
Re: Sqoop to HDFS error Cannot initialize cluster
Awesome stuff Brenden! Glad all is working! And thanks for reporting back!
On Fri, Jan 31, 2014 at 1:41 PM, Brenden Cobb <[EMAIL PROTECTED]>wrote:

>  Yay! I disabled oraOop and got clued to the final piece I think I was
> missing... -m1 since there is no primary key.
>
>  The final output:
> $sqoop import --connect jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G
> --username sqoop --password xx --table SQOOP.TEST -m1
>
>  Successful
>
>
>  So it looks like in all I needed to:
> -- Point Sqoop-env.xml to hadoop-0.20-mapreduce
> -- Capitalize both owner and table name: SQOOP.TEST
> -- Add -m1 at the end to make up for the lack of a primary key.
>
>  Thank-you again Abe for your guidance and help.
>
>  Cheers!
> BC
>
>
>   From: Brenden Cobb <[EMAIL PROTECTED]>
> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Date: Friday, January 31, 2014 3:41 PM
>
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Subject: Re: Sqoop to HDFS error Cannot initialize cluster
>
>   Hey-
>
>  I can run the list tables command without issue:
>  qoop list-tables --connect
> jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username
> sqoop --password sqoopWarning: /usr/lib/hcatalog does not exist! HCatalog
> jobs will fail.
> Please set $HCAT_HOME to the root of your HCatalog installation.
> 14/01/31 15:36:59 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
> 14/01/31 15:36:59 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 14/01/31 15:36:59 INFO manager.SqlManager: Using default fetchSize of 1000
> 14/01/31 15:37:00 INFO manager.OracleManager: Time zone has been set to GMT
> *TEST*
>
>  I tried without the SQOOP owner prefix with the same result. Going back
> through the OraOop doc to make sure I did not miss something permissions
> related...
>
>  Perhaps found some clues here:
>
> https://groups.google.com/a/cloudera.org/forum/#!topic/sqoop-user/RNWL62iHFpU
>
>  BC
>
>   From: Abraham Elmahrek <[EMAIL PROTECTED]>
> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Date: Friday, January 31, 2014 3:00 PM
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Subject: Re: Sqoop to HDFS error Cannot initialize cluster
>
>   Awesome! Glad you're moving forward.
>
>  For your new exception. Have you verified the table you're trying to
> import is owned by the SQOOP user? Also, you may not need the "SQOOP."
> prefix in the table parameter.
>
>  -Abe
>
>
> On Fri, Jan 31, 2014 at 10:57 AM, Brenden Cobb <[EMAIL PROTECTED]>wrote:
>
>>  Hi Abe- thanks for your continued help on this issue. I changed my
>> SQOOP env setting to point to .20 mapreduce and seem to have progressed (or
>> stepped back?)
>>
>>  It appears I've moved beyond the Mapreduce error and into JDBC
>> connector errors... Any thoughts are appreciated.
>>
>>
>>  [$ sqoop import --connect
>> jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username
>> SQOOP --password xx --table SQOOP.test --verbose
>>
>>  14/01/31 13:50:01 INFO sqoop.Sqoop: Running Sqoop version:
>> 1.4.3-cdh4.5.0
>> 14/01/31 13:50:01 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>> 14/01/31 13:50:01 WARN tool.BaseSqoopTool: Setting your password on the
>> command-line is insecure. Consider using -P instead.
>> 14/01/31 13:50:01 DEBUG util.ClassLoaderStack: Checking for existing
>> class: com.quest.oraoop.OraOopManagerFactory
>> 14/01/31 13:50:01 DEBUG util.ClassLoaderStack: Class is already
>> available. Skipping jar
>> /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar
>> 14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Added factory
>> com.quest.oraoop.OraOopManagerFactory in jar
>> /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar specified by
>> /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/sqoop/conf/managers.d/oraoop
>> 14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Loaded manager factory:
>> com.quest.oraoop.OraOopManagerFactory
>> 14/01/31 13:50
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB