Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # user >> Jobs failing with ClassNotFoundException


Copy link to this message
-
Jobs failing with ClassNotFoundException
Hi everyone,

I've got a job I'm running that I can't figure out why it's failing.  I've
tried running jobs from the examples, and they work just fine.  I'm running
the job via

> ./bin/tool.sh ~/MovingAverage.jar movingaverage.MAJob inst namenode root
pass stockdata movingaverage

which I see is running the following exec call that seems perfect to me:

exec /usr/lib/hadoop/bin/hadoop jar /MovingAverage.jar movingaverage.MAJob
-libjars "/opt/accumulo/lib/libthrift-0.6.1.jar,/opt/accumulo/lib/
accumulo-core-1.4.2.jar,/usr/lib/zookeeper//zookeeper-3.3.
5-cdh3u5.jar,/opt/accumulo/lib/cloudtrace-1.4.2.jar,/opt/
accumulo/lib/commons-collections-3.2.jar,/opt/accumulo/lib/commons-
configuration-1.5.jar,/opt/accumulo/lib/commons-io-1.4.
jar,/opt/accumulo/lib/commons-jci-core-1.0.jar,/opt/
accumulo/lib/commons-jci-fam-1.0.jar,/opt/accumulo/lib/
commons-lang-2.4.jar,/opt/accumulo/lib/commons-logging-
1.0.4.jar,/opt/accumulo/lib/commons-logging-api-1.0.4.jar" inst namenode
root pass tmpdatatable movingaverage

but when the job runs, it gets to the map phase and fails:

13/02/14 13:25:26 INFO mapred.JobClient: Task Id :
attempt_201301171408_0293_m_000000_0, Status : FAILED
java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.apache.accumulo.core.client.mapreduce.AccumuloInputFormat
    at org.apache.hadoop.conf.Configuration.getClass(
Configuration.java:1004)
    at org.apache.hadoop.mapreduce.JobContext.getInputFormatClass(
JobContext.java:205)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:606)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1278)
    at org.apache.hadoop.mapred.Child.main(Child.java:260)
Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.core.
client.mapreduce.AccumuloInputFormat
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)

I've also tried hacking it to work by adding the accumulo-core jar to
hadoop's lib dir, but that doesn't seem to work either.

Thanks for any help,
--
Chris
+
Billie Rinaldi 2013-02-14, 18:51
+
Chris Sigman 2013-02-14, 18:53
+
Keith Turner 2013-02-14, 19:17
+
Chris Sigman 2013-02-14, 19:20
+
William Slacum 2013-02-14, 19:34
+
Chris Sigman 2013-02-14, 20:17
+
Chris Sigman 2013-02-14, 21:07
+
Keith Turner 2013-02-14, 21:15
+
Chris Sigman 2013-02-15, 14:49
+
John Vines 2013-02-14, 19:11
+
Chris Sigman 2013-02-14, 19:14
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB