Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Importing Standard Python Modules in Jython UDFs in MapReduce Mode


Copy link to this message
-
Re: Importing Standard Python Modules in Jython UDFs in MapReduce Mode
Norbert Burger 2012-06-20, 01:43
Have you included the jython.jar in your PIG_CLASSPATH and registered from
within your script?  The combination instructs the Pig backend to ship the
JAR to your cluster nodes.

Norbert

On Tue, Jun 19, 2012 at 8:28 PM, Chris Diehl <[EMAIL PROTECTED]> wrote:

> yes indeed.
>
> On Tue, Jun 19, 2012 at 5:27 PM, Duckworth, Will <[EMAIL PROTECTED]
> >wrote:
>
> > You have built a standalone version of jython right?
> >
> > On Jun 19, 2012, at 8:16 PM, "Chris Diehl" <[EMAIL PROTECTED]> wrote:
> >
> > > Hi All,
> > >
> > > I've yet to be able to successfully import the datetime module in a
> > Jython
> > > UDF when running my Pig script on our cluster. Having perused past
> > message
> > > traffic, it seems the answer was to put the jython.jar in
> > /usr/lib/pig/lib.
> > > That did not resolve the problem for me. I've tried both Jython 2.5 and
> > > 2.5.2 with Pig 0.8. Any other standard steps I should be doing to get
> > this
> > > to work?
> > >
> > > Thanks, Chris
> >
> >
> > Will Duckworth  Senior Vice President, Software Engineering  | comScore,
> > Inc.(NASDAQ:SCOR)
> > o +1 (703) 438-2108 | m +1 (301) 606-2977 | mailto:
> [EMAIL PROTECTED]
> >
> >
> .....................................................................................................
> >
> > Introducing Mobile Metrix 2.0 - The next generation of mobile behavioral
> > measurement
> > www.comscore.com/MobileMetrix
> >
>