Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Sqoop and OSGI


+
corbacho anthony 2013-06-19, 06:25
+
Jarek Jarcec Cecho 2013-06-19, 14:57
+
Abraham Elmahrek 2013-06-19, 17:52
+
corbacho anthony 2013-06-20, 01:17
+
Jarek Jarcec Cecho 2013-06-20, 01:28
+
corbacho anthony 2013-06-20, 01:33
+
corbacho anthony 2013-06-20, 01:53
+
Abraham Elmahrek 2013-06-20, 03:50
+
corbacho anthony 2013-06-21, 01:44
Copy link to this message
-
Re: Sqoop and OSGI
Anthony,

You've set that configuration incorrectly. It should be conf.set(
"sqoop.connection.factories", "com.cloudera.sqoop.manager.ConnMananger");.
Sqoop instantiates a Configuration object and adds resources to it.

-Abe
On Thu, Jun 20, 2013 at 6:44 PM, corbacho anthony <[EMAIL PROTECTED]>wrote:

> Hello Abe.
>
> The think is, I didn`t install sqoop, I use it via pom on my java code.
> I added on my code this:
>
> Configuration conf = new HdfsConfiguration();
> conf.set("sqoop.connection.factories",
> "com.cloudera.sqoop.apache.ConnMananger");
> [....]
>
> return Sqoop.runTool(str, conf);
> But still the same error.
>
>
> On Thu, Jun 20, 2013 at 12:50 PM, Abraham Elmahrek <[EMAIL PROTECTED]>wrote:
>
>> Anthony,
>>
>> Weird, that should be com.cloudera.sqoop.manager.ConnMananger. I suspect
>> there's a problem with your sqoop-site.xml (if its even being parsed at
>> all) or classpath. The sqoop startup script sets SQOOP_HOME_DIR,
>> SQOOP_CONF_DIR, HADOOP_CLASSPATH, and a few other environment variables. I
>> suspect there's something required there.
>>
>> -Abe
>>
>>
>> On Wed, Jun 19, 2013 at 6:53 PM, corbacho anthony <[EMAIL PROTECTED]>wrote:
>>
>>> I tried an same issues.
>>> The problem is Sqoop cannot
>>> find com.cloudera.sqoop.apache.ConnMananger...
>>>
>>>
>>> On Thu, Jun 20, 2013 at 10:33 AM, corbacho anthony <[EMAIL PROTECTED]
>>> > wrote:
>>>
>>>> I used
>>>> https://repository.cloudera.com/artifactory/cloudera-repos/com/cloudera/sqoop/sqoop/
>>>>
>>>> I will try with sqoop 1.4.3.
>>>> Thank you Jarec.
>>>>
>>>> Anthony
>>>>
>>>>
>>>> On Thu, Jun 20, 2013 at 10:28 AM, Jarek Jarcec Cecho <[EMAIL PROTECTED]
>>>> > wrote:
>>>>
>>>>> Hi Anthony,
>>>>> what maven repository are you using?
>>>>>
>>>>> Cloudera maven repository [1] seems to be containing all released
>>>>> versions (instructions how to use this repository are in installation guide
>>>>> [3]). Also thanks to SQOOP-1007 we do have vanila Sqoop artifacts available
>>>>> in main maven repository [2].
>>>>>
>>>>> Jarcec
>>>>>
>>>>> Links:
>>>>> 1:
>>>>> https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/sqoop/sqoop/
>>>>> 2: http://search.maven.org/#browse%7C585117616
>>>>> 3:
>>>>> http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-Installation-Guide/cdh4ig_topic_31.html
>>>>>
>>>>> On Thu, Jun 20, 2013 at 10:17:35AM +0900, corbacho anthony wrote:
>>>>> > hello Jarec and Abe.
>>>>> >
>>>>> > Abe: the debugging mode show nothing :(
>>>>> > Jarec: In cloudera repo I can only find Sqoop 1.4.0.
>>>>> >
>>>>> > There is the full stack (in case):
>>>>> > 2013-06-20 10:10:29,022 | ERROR | qtp1742391956-59 | ConnFactory |
>>>>> Could
>>>>> > not load ManagerFactory com.cloudera.sqoop.apache.ConnMananger (not
>>>>> found)
>>>>> > 2013-06-20 10:10:29,023 | ERROR | qtp1742391956-59 | BaseSqoopTool |
>>>>> Got
>>>>> > error creating database manager: java.io.IOException: No manager for
>>>>> > connect string: jdbc:mysql://xxx:0000/x
>>>>> > at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:119)
>>>>> > at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:202)
>>>>> > at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
>>>>> > at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:441)
>>>>> > at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
>>>>> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>>>>> > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
>>>>> > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
>>>>> > at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:49)
>>>>> > at
>>>>> com.nflabs.com.peloton.imprt.db.SqoopImport.tested(SqoopImport.java:131)
>>>>> > at
>>>>> com.nflabs.peloton.imprt.impl.ImprtSvcImpl.test(ImprtSvcImpl.java:191)
>>>>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> > at
>>>>> >
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> > at
>>>>> >
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
+
corbacho anthony 2013-06-21, 05:53
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB