Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Library conflict with Pig UDF


Copy link to this message
-
Re: Library conflict with Pig UDF
Shawn Hermans 2013-12-11, 17:54
I added SET mapreduce.task.classpath.user.precedence true; to the top of my
script and it worked.

Thanks,
Shawn
On Tue, Dec 10, 2013 at 11:36 PM, Serega Sheypak
<[EMAIL PROTECTED]>wrote:

> You have to specify classpath precedence. See here
>
> http://stackoverflow.com/questions/11685949/overriding-default-hadoop-jars-in-class-path
> 11.12.2013 7:02 пользователь "Shawn Hermans" <[EMAIL PROTECTED]>
> написал:
>
> > I am having an issue with a Pig UDF I wrote.  The Pig UDF uses a newer
> > version of Guava than is bundled with the version of Hadoop I am using
> (CDH
> > 4.2).  I explicitly register the newer version using a REGISTER
> statement.
> >  However, it still loads the version bundled with CDH.  How do I get Pig
> to
> > recognize the and load the correct version of Guava?
> >
> > Thanks,
> > Shawn
> >
>