Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop, mail # user - Sqoop and OSGI


+
corbacho anthony 2013-06-19, 06:25
+
Jarek Jarcec Cecho 2013-06-19, 14:57
+
Abraham Elmahrek 2013-06-19, 17:52
+
corbacho anthony 2013-06-20, 01:17
+
Jarek Jarcec Cecho 2013-06-20, 01:28
+
corbacho anthony 2013-06-20, 01:33
+
corbacho anthony 2013-06-20, 01:53
+
Abraham Elmahrek 2013-06-20, 03:50
+
corbacho anthony 2013-06-21, 01:44
Copy link to this message
-
Re: Sqoop and OSGI
Abraham Elmahrek 2013-06-21, 05:41
Anthony,

You've set that configuration incorrectly. It should be conf.set(
"sqoop.connection.factories", "com.cloudera.sqoop.manager.ConnMananger");.
Sqoop instantiates a Configuration object and adds resources to it.

-Abe
On Thu, Jun 20, 2013 at 6:44 PM, corbacho anthony <[EMAIL PROTECTED]>wrote:

> Hello Abe.
>
> The think is, I didn`t install sqoop, I use it via pom on my java code.
> I added on my code this:
>
> Configuration conf = new HdfsConfiguration();
> conf.set("sqoop.connection.factories",
> "com.cloudera.sqoop.apache.ConnMananger");
> [....]
>
> return Sqoop.runTool(str, conf);
> But still the same error.
>
>
> On Thu, Jun 20, 2013 at 12:50 PM, Abraham Elmahrek <[EMAIL PROTECTED]>wrote:
>
>> Anthony,
>>
>> Weird, that should be com.cloudera.sqoop.manager.ConnMananger. I suspect
>> there's a problem with your sqoop-site.xml (if its even being parsed at
>> all) or classpath. The sqoop startup script sets SQOOP_HOME_DIR,
>> SQOOP_CONF_DIR, HADOOP_CLASSPATH, and a few other environment variables. I
>> suspect there's something required there.
>>
>> -Abe
>>
>>
>> On Wed, Jun 19, 2013 at 6:53 PM, corbacho anthony <[EMAIL PROTECTED]>wrote:
>>
>>> I tried an same issues.
>>> The problem is Sqoop cannot
>>> find com.cloudera.sqoop.apache.ConnMananger...
>>>
>>>
>>> On Thu, Jun 20, 2013 at 10:33 AM, corbacho anthony <[EMAIL PROTECTED]
>>> > wrote:
>>>
>>>> I used
>>>> https://repository.cloudera.com/artifactory/cloudera-repos/com/cloudera/sqoop/sqoop/
>>>>
>>>> I will try with sqoop 1.4.3.
>>>> Thank you Jarec.
>>>>
>>>> Anthony
>>>>
>>>>
>>>> On Thu, Jun 20, 2013 at 10:28 AM, Jarek Jarcec Cecho <[EMAIL PROTECTED]
>>>> > wrote:
>>>>
>>>>> Hi Anthony,
>>>>> what maven repository are you using?
>>>>>
>>>>> Cloudera maven repository [1] seems to be containing all released
>>>>> versions (instructions how to use this repository are in installation guide
>>>>> [3]). Also thanks to SQOOP-1007 we do have vanila Sqoop artifacts available
>>>>> in main maven repository [2].
>>>>>
>>>>> Jarcec
>>>>>
>>>>> Links:
>>>>> 1:
>>>>> https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/sqoop/sqoop/
>>>>> 2: http://search.maven.org/#browse%7C585117616
>>>>> 3:
>>>>> http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Installation-Guide/cdh4ig_topic_31.html
>>>>>
>>>>> On Thu, Jun 20, 2013 at 10:17:35AM +0900, corbacho anthony wrote:
>>>>> > hello Jarec and Abe.
>>>>> >
>>>>> > Abe: the debugging mode show nothing :(
>>>>> > Jarec: In cloudera repo I can only find Sqoop 1.4.0.
>>>>> >
>>>>> > There is the full stack (in case):
>>>>> > 2013-06-20 10:10:29,022 | ERROR | qtp1742391956-59 | ConnFactory |
>>>>> Could
>>>>> > not load ManagerFactory com.cloudera.sqoop.apache.ConnMananger (not
>>>>> found)
>>>>> > 2013-06-20 10:10:29,023 | ERROR | qtp1742391956-59 | BaseSqoopTool |
>>>>> Got
>>>>> > error creating database manager: java.io.IOException: No manager for
>>>>> > connect string: jdbc:mysql://xxx:0000/x
>>>>> > at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:119)
>>>>> > at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:202)
>>>>> > at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
>>>>> > at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:441)
>>>>> > at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
>>>>> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>>>>> > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
>>>>> > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
>>>>> > at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:49)
>>>>> > at
>>>>> com.nflabs.com.peloton.imprt.db.SqoopImport.tested(SqoopImport.java:131)
>>>>> > at
>>>>> com.nflabs.peloton.imprt.impl.ImprtSvcImpl.test(ImprtSvcImpl.java:191)
>>>>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> > at
>>>>> >
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> > at
>>>>> >
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
+
corbacho anthony 2013-06-21, 05:53