Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Re: Adding external jar


Copy link to this message
-
Re: Adding external jar
I am not sure if my classpath is set up right. See:

*[hadoop@node]$ cat /opt/hadoop/conf/hadoop-env.sh | grep HADOOP_CLASSPATH*
export HADOOP_CLASSPATH=./:/conf:/build/*:

and the specific command I was trying to run was actually running a
mapreduce job on accumulo and was providing some accumulo libraries in the
-libjars.

*[hadoop@node]$ /opt/hadoop/bin/hadoop jar *
*/opt/accumulo/lib/examples-simple-1.4.2.jar
org.apache.accumulo.examples.simple.mapreduce.bulk.BulkIngestExample *
*-libjars *
*
"/opt/accumulo/lib/libthrift-0.6.1.jar,/opt/accumulo/lib/accumulo-core-1.4.2.jar,/opt/zookeeper/zookeeper-3.3.3.jar,/opt/accumulo/lib/cloudtrace-1.4.2.jar,/opt/accumulo/lib/commons-collections-3.2.jar,/opt/accumulo/lib/commons-configuration-1.5.jar,/opt/accumulo/lib/commons-io-1.4.jar,/opt/accumulo/lib/commons-jci-core-1.0.jar,/opt/accumulo/lib/commons-jci-fam-1.0.jar,/opt/accumulo/lib/commons-lang-2.4.jar,/opt/accumulo/lib/commons-logging-1.0.4.jar,/opt/accumulo/lib/commons-logging-api-1.0.4.jar"
*

Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/accumulo/core/client/Instance
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:149)
Caused by: java.lang.ClassNotFoundException:
org.apache.accumulo.core.client.Instance
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:423)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
        ... 3 more
But org/apache/accumulo/core/client/Instance exists in
*/opt/accumulo/lib/accumulo-core-1.4.2.jar,
*any clue whats going wrong here?

On Thu, Apr 4, 2013 at 3:57 PM, Dhruv <[EMAIL PROTECTED]> wrote:

> -libjar should work fine but you need to make sure that your jars are in
> the Hadoop client's classpath as well.
>
> Check HADOOP_CLASSPATH variable and see if it references your jars or not.
>
> If it doesn't, you can add "export HADOOP_CLASSPATH=/path/to/your/jar" in
> your conf/hadoop-env.sh file.
>
>
> On Thu, Apr 4, 2013 at 12:21 PM, Aji Janis <[EMAIL PROTECTED]> wrote:
>
>> We are running (ancient) hadoop version 0.20.203 and when running the
>> following command
>>
>> /opt/hadoop/bin/hadoop jar my.jar full.path.to.my.class.example -libjars
>> " /opt/../abc.jar, /opt/../xyz.jar"
>>
>> it keeps throwing the error:
>> Exception in thread "main" java.lang.NoClassDefFoundError:
>>
>> the class its complaining about exists is the .jar I am including in
>> -libjars. Does anyone know (or tell me how I can find) if 0.20.203 supports
>> -libjars ? or any pointers to how can debug this issue would be great.
>> Thankyou.
>>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB