Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Sqoop to HDFS error Cannot initialize cluster


Copy link to this message
-
Re: Sqoop to HDFS error Cannot initialize cluster
Abraham Elmahrek 2014-01-31, 21:59
Awesome stuff Brenden! Glad all is working! And thanks for reporting back!
On Fri, Jan 31, 2014 at 1:41 PM, Brenden Cobb <[EMAIL PROTECTED]>wrote:

>  Yay! I disabled oraOop and got clued to the final piece I think I was
> missing... -m1 since there is no primary key.
>
>  The final output:
> $sqoop import --connect jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G
> --username sqoop --password xx --table SQOOP.TEST -m1
>
>  Successful
>
>
>  So it looks like in all I needed to:
> -- Point Sqoop-env.xml to hadoop-0.20-mapreduce
> -- Capitalize both owner and table name: SQOOP.TEST
> -- Add -m1 at the end to make up for the lack of a primary key.
>
>  Thank-you again Abe for your guidance and help.
>
>  Cheers!
> BC
>
>
>   From: Brenden Cobb <[EMAIL PROTECTED]>
> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Date: Friday, January 31, 2014 3:41 PM
>
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Subject: Re: Sqoop to HDFS error Cannot initialize cluster
>
>   Hey-
>
>  I can run the list tables command without issue:
>  qoop list-tables --connect
> jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username
> sqoop --password sqoopWarning: /usr/lib/hcatalog does not exist! HCatalog
> jobs will fail.
> Please set $HCAT_HOME to the root of your HCatalog installation.
> 14/01/31 15:36:59 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
> 14/01/31 15:36:59 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 14/01/31 15:36:59 INFO manager.SqlManager: Using default fetchSize of 1000
> 14/01/31 15:37:00 INFO manager.OracleManager: Time zone has been set to GMT
> *TEST*
>
>  I tried without the SQOOP owner prefix with the same result. Going back
> through the OraOop doc to make sure I did not miss something permissions
> related...
>
>  Perhaps found some clues here:
>
> https://groups.google.com/a/cloudera.org/forum/#!topic/sqoop-user/RNWL62iHFpU
>
>  BC
>
>   From: Abraham Elmahrek <[EMAIL PROTECTED]>
> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Date: Friday, January 31, 2014 3:00 PM
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Subject: Re: Sqoop to HDFS error Cannot initialize cluster
>
>   Awesome! Glad you're moving forward.
>
>  For your new exception. Have you verified the table you're trying to
> import is owned by the SQOOP user? Also, you may not need the "SQOOP."
> prefix in the table parameter.
>
>  -Abe
>
>
> On Fri, Jan 31, 2014 at 10:57 AM, Brenden Cobb <[EMAIL PROTECTED]>wrote:
>
>>  Hi Abe- thanks for your continued help on this issue. I changed my
>> SQOOP env setting to point to .20 mapreduce and seem to have progressed (or
>> stepped back?)
>>
>>  It appears I've moved beyond the Mapreduce error and into JDBC
>> connector errors... Any thoughts are appreciated.
>>
>>
>>  [$ sqoop import --connect
>> jdbc:oracle:thin:@som-dmsandbox03.humedica.net:1521:DB11G --username
>> SQOOP --password xx --table SQOOP.test --verbose
>>
>>  14/01/31 13:50:01 INFO sqoop.Sqoop: Running Sqoop version:
>> 1.4.3-cdh4.5.0
>> 14/01/31 13:50:01 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>> 14/01/31 13:50:01 WARN tool.BaseSqoopTool: Setting your password on the
>> command-line is insecure. Consider using -P instead.
>> 14/01/31 13:50:01 DEBUG util.ClassLoaderStack: Checking for existing
>> class: com.quest.oraoop.OraOopManagerFactory
>> 14/01/31 13:50:01 DEBUG util.ClassLoaderStack: Class is already
>> available. Skipping jar
>> /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar
>> 14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Added factory
>> com.quest.oraoop.OraOopManagerFactory in jar
>> /opt/cloudera/parcels/CDH/lib/sqoop/lib/oraoop-1.6.0.jar specified by
>> /opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/sqoop/conf/managers.d/oraoop
>> 14/01/31 13:50:01 DEBUG sqoop.ConnFactory: Loaded manager factory:
>> com.quest.oraoop.OraOopManagerFactory
>> 14/01/31 13:50