Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # user >> Jobs failing with ClassNotFoundException


Copy link to this message
-
Re: Jobs failing with ClassNotFoundException
I should also note that my job does implement Tool.

Thanks,
--
Chris
On Feb 14, 2013 2:12 PM, "John Vines" <[EMAIL PROTECTED]> wrote:

> He shouldn't have to, since he's using tool.sh, which uses -libjars.
> Unless cdh3u5 changed -libjars behavior?
>
>
> On Thu, Feb 14, 2013 at 1:51 PM, Billie Rinaldi <[EMAIL PROTECTED]> wrote:
>
>> On Thu, Feb 14, 2013 at 10:41 AM, Chris Sigman <[EMAIL PROTECTED]>wrote:
>>
>>> Hi everyone,
>>>
>>> I've got a job I'm running that I can't figure out why it's failing.
>>>  I've tried running jobs from the examples, and they work just fine.  I'm
>>> running the job via
>>>
>>> > ./bin/tool.sh ~/MovingAverage.jar movingaverage.MAJob inst namenode
>>> root pass stockdata movingaverage
>>>
>>> which I see is running the following exec call that seems perfect to me:
>>>
>>> exec /usr/lib/hadoop/bin/hadoop jar /MovingAverage.jar
>>> movingaverage.MAJob -libjars "/opt/accumulo/lib/libthrift-
>>> 0.6.1.jar,/opt/accumulo/lib/accumulo-core-1.4.2.jar,/usr/
>>> lib/zookeeper//zookeeper-3.3.5-cdh3u5.jar,/opt/accumulo/
>>> lib/cloudtrace-1.4.2.jar,/opt/accumulo/lib/commons-
>>> collections-3.2.jar,/opt/accumulo/lib/commons-
>>> configuration-1.5.jar,/opt/accumulo/lib/commons-io-1.4.
>>> jar,/opt/accumulo/lib/commons-jci-core-1.0.jar,/opt/
>>> accumulo/lib/commons-jci-fam-1.0.jar,/opt/accumulo/lib/
>>> commons-lang-2.4.jar,/opt/accumulo/lib/commons-logging-
>>> 1.0.4.jar,/opt/accumulo/lib/commons-logging-api-1.0.4.jar" inst
>>> namenode root pass tmpdatatable movingaverage
>>>
>>
>> Does /opt/accumulo/lib/accumulo-core-1.4.2.jar exist on your hadoop
>> nodes, specifically the one that's running the map?
>>
>> Billie
>>
>>
>>
>>>
>>> but when the job runs, it gets to the map phase and fails:
>>>
>>> 13/02/14 13:25:26 INFO mapred.JobClient: Task Id :
>>> attempt_201301171408_0293_m_000000_0, Status : FAILED
>>> java.lang.RuntimeException: java.lang.ClassNotFoundException:
>>> org.apache.accumulo.core.client.mapreduce.AccumuloInputFormat
>>>     at org.apache.hadoop.conf.Configuration.getClass(
>>> Configuration.java:1004)
>>>     at org.apache.hadoop.mapreduce.JobContext.getInputFormatClass(
>>> JobContext.java:205)
>>>     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:606)
>>>     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>>>     at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
>>>     at java.security.AccessController.doPrivileged(Native Method)
>>>     at javax.security.auth.Subject.doAs(Subject.java:415)
>>>     at org.apache.hadoop.security.UserGroupInformation.doAs(
>>> UserGroupInformation.java:1278)
>>>     at org.apache.hadoop.mapred.Child.main(Child.java:260)
>>> Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.core.
>>> client.mapreduce.AccumuloInputFormat
>>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>>     at java.security.AccessController.doPrivileged(Native Method)
>>>
>>> I've also tried hacking it to work by adding the accumulo-core jar to
>>> hadoop's lib dir, but that doesn't seem to work either.
>>>
>>> Thanks for any help,
>>> --
>>> Chris
>>>
>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB