I am running a map-reduce job. As soon as my mapper tried to serialize
a Mutation I run into a NoSuchMethodError in reference to
FieldValueMetaData. I could simply delete the hue-plugins jar file but
that seems inelegant to me. When running a mapper can I shift when the
jar files are loaded? Would HADOOP_USER_CLASSPATH_FIRST help in this
situation? What about adding the libthift jar file to the
sun.boot.class.path property?

On Fri, Feb 8, 2013 at 10:34 AM, David Medinets <[EMAIL PROTECTED]>wrote:

> I am running a map-reduce job. As soon as my mapper tried to serialize
> a Mutation I run into a NoSuchMethodError in reference to
> FieldValueMetaData. I could simply delete the hue-plugins jar file but
> that seems inelegant to me. When running a mapper can I shift when the
> jar files are loaded? Would HADOOP_USER_CLASSPATH_FIRST help in this
> situation? What about adding the libthift jar file to the
> sun.boot.class.path property?
>

I found a likely answer by searching for "hadoop distributedcache
precedence" which located p. 163 of Hadoop: The Definitive Guide. It
mentions this issue specifically under "Task Classpath Precedence."  On the
client side, you can force Hadoop to put the user classpath first by
setting HADOOP_USER_CLASSPATH_FIRST to true.  However, for a task
classpath, you should set "mapreduce.task.classpath.first" to true.  A bit
more searching leads me to believe that this property name is different in
different versions of Hadoop.  I just checked 1.0.3 and it appears to be
"mapreduce.user.classpath.first" there.  This question indicates there
could be at least two other possible values:
http://stackoverflow.com/questions/11685949/overriding-default-hadoop-jars-in-class-path

Apparently you should check the static property names in
org.apache.hadoop.mapred.TaskRunner to find the appropriate property name
for your version of Hadoop.  Let us know if that works!

Billie

Is that related to https://issues.apache.org/jira/browse/ACCUMULO-837? Do
you have a stack trace you can share?

Adam

On Fri, Feb 8, 2013 at 10:34 AM, David Medinets <[EMAIL PROTECTED]>wrote:

> I am running a map-reduce job. As soon as my mapper tried to serialize
> a Mutation I run into a NoSuchMethodError in reference to
> FieldValueMetaData. I could simply delete the hue-plugins jar file but
> that seems inelegant to me. When running a mapper can I shift when the
> jar files are loaded? Would HADOOP_USER_CLASSPATH_FIRST help in this
> situation? What about adding the libthift jar file to the
> sun.boot.class.path property?
>

No, that does not seem to be related.

 java.lang.NoSuchMethodError:
org.apache.thrift.meta_data.FieldValueMetaValue.<init>(BZ)V
  at org.apache.accumulo.core.data.thrift.TMutation.<clinit>(TMutation.java:110)
  at org.apache.accumulo.core.data.Mutation.toThrift(Mutation.java:518)
This message, http://mail-archives.apache.org/mod_mbox/accumulo-user/201206.mbox/%3CCAPhC5mopp-nKZ8Z0ZHKYLLTT5rsMj9wQfRGwFr=7aViMMDmk+[EMAIL PROTECTED]%3E,
mentions this issue.

This message, http://mail-archives.apache.org/mod_mbox/accumulo-user/201206.mbox/%[EMAIL PROTECTED]%3e,
says to delete the hue-plugins jar file.

I'm hoping in the last year the collective wisdom of the Internet has
developed a different approach.

On Fri, Feb 8, 2013 at 10:47 AM, Adam Fuchs <[EMAIL PROTECTED]> wrote:
> Is that related to https://issues.apache.org/jira/browse/ACCUMULO-837? Do
> you have a stack trace you can share?
>
> Adam
>
>
>
> On Fri, Feb 8, 2013 at 10:34 AM, David Medinets <[EMAIL PROTECTED]>
> wrote:
>>
>> I am running a map-reduce job. As soon as my mapper tried to serialize
>> a Mutation I run into a NoSuchMethodError in reference to
>> FieldValueMetaData. I could simply delete the hue-plugins jar file but
>> that seems inelegant to me. When running a mapper can I shift when the
>> jar files are loaded? Would HADOOP_USER_CLASSPATH_FIRST help in this
>> situation? What about adding the libthift jar file to the
>> sun.boot.class.path property?
>
>