Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # user >> NoSuchMethodError: FieldValueMetaData (Conflict between hue-plugins-1.2.0-cdh3u5.har and libthrift-0.6.1.jar)


+
David Medinets 2013-02-08, 15:34
Copy link to this message
-
Re: NoSuchMethodError: FieldValueMetaData (Conflict between hue-plugins-1.2.0-cdh3u5.har and libthrift-0.6.1.jar)
On Fri, Feb 8, 2013 at 10:34 AM, David Medinets <[EMAIL PROTECTED]>wrote:

> I am running a map-reduce job. As soon as my mapper tried to serialize
> a Mutation I run into a NoSuchMethodError in reference to
> FieldValueMetaData. I could simply delete the hue-plugins jar file but
> that seems inelegant to me. When running a mapper can I shift when the
> jar files are loaded? Would HADOOP_USER_CLASSPATH_FIRST help in this
> situation? What about adding the libthift jar file to the
> sun.boot.class.path property?
>

I found a likely answer by searching for "hadoop distributedcache
precedence" which located p. 163 of Hadoop: The Definitive Guide. It
mentions this issue specifically under "Task Classpath Precedence."  On the
client side, you can force Hadoop to put the user classpath first by
setting HADOOP_USER_CLASSPATH_FIRST to true.  However, for a task
classpath, you should set "mapreduce.task.classpath.first" to true.  A bit
more searching leads me to believe that this property name is different in
different versions of Hadoop.  I just checked 1.0.3 and it appears to be
"mapreduce.user.classpath.first" there.  This question indicates there
could be at least two other possible values:
http://stackoverflow.com/questions/11685949/overriding-default-hadoop-jars-in-class-path

Apparently you should check the static property names in
org.apache.hadoop.mapred.TaskRunner to find the appropriate property name
for your version of Hadoop.  Let us know if that works!

Billie
+
Adam Fuchs 2013-02-08, 15:47
+
David Medinets 2013-02-08, 16:05
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB