|
|
-
Importing Standard Python Modules in Jython UDFs in MapReduce Mode
Chris Diehl 2012-06-20, 00:15
Hi All,
I've yet to be able to successfully import the datetime module in a Jython UDF when running my Pig script on our cluster. Having perused past message traffic, it seems the answer was to put the jython.jar in /usr/lib/pig/lib. That did not resolve the problem for me. I've tried both Jython 2.5 and 2.5.2 with Pig 0.8. Any other standard steps I should be doing to get this to work?
Thanks, Chris
-
Re: Importing Standard Python Modules in Jython UDFs in MapReduce Mode
Duckworth, Will 2012-06-20, 00:27
You have built a standalone version of jython right?
On Jun 19, 2012, at 8:16 PM, "Chris Diehl" <[EMAIL PROTECTED]> wrote:
> Hi All, > > I've yet to be able to successfully import the datetime module in a Jython > UDF when running my Pig script on our cluster. Having perused past message > traffic, it seems the answer was to put the jython.jar in /usr/lib/pig/lib. > That did not resolve the problem for me. I've tried both Jython 2.5 and > 2.5.2 with Pig 0.8. Any other standard steps I should be doing to get this > to work? > > Thanks, Chris Will Duckworth Senior Vice President, Software Engineering | comScore, Inc.(NASDAQ:SCOR) o +1 (703) 438-2108 | m +1 (301) 606-2977 | mailto:[EMAIL PROTECTED] .....................................................................................................
Introducing Mobile Metrix 2.0 - The next generation of mobile behavioral measurement www.comscore.com/MobileMetrix
-
Re: Importing Standard Python Modules in Jython UDFs in MapReduce Mode
Chris Diehl 2012-06-20, 00:28
yes indeed.
On Tue, Jun 19, 2012 at 5:27 PM, Duckworth, Will <[EMAIL PROTECTED]>wrote:
> You have built a standalone version of jython right? > > On Jun 19, 2012, at 8:16 PM, "Chris Diehl" <[EMAIL PROTECTED]> wrote: > > > Hi All, > > > > I've yet to be able to successfully import the datetime module in a > Jython > > UDF when running my Pig script on our cluster. Having perused past > message > > traffic, it seems the answer was to put the jython.jar in > /usr/lib/pig/lib. > > That did not resolve the problem for me. I've tried both Jython 2.5 and > > 2.5.2 with Pig 0.8. Any other standard steps I should be doing to get > this > > to work? > > > > Thanks, Chris > > > Will Duckworth Senior Vice President, Software Engineering | comScore, > Inc.(NASDAQ:SCOR) > o +1 (703) 438-2108 | m +1 (301) 606-2977 | mailto:[EMAIL PROTECTED] > > ..................................................................................................... > > Introducing Mobile Metrix 2.0 - The next generation of mobile behavioral > measurement > www.comscore.com/MobileMetrix >
-
Re: Importing Standard Python Modules in Jython UDFs in MapReduce Mode
Norbert Burger 2012-06-20, 01:43
Have you included the jython.jar in your PIG_CLASSPATH and registered from within your script? The combination instructs the Pig backend to ship the JAR to your cluster nodes.
Norbert
On Tue, Jun 19, 2012 at 8:28 PM, Chris Diehl <[EMAIL PROTECTED]> wrote:
> yes indeed. > > On Tue, Jun 19, 2012 at 5:27 PM, Duckworth, Will <[EMAIL PROTECTED] > >wrote: > > > You have built a standalone version of jython right? > > > > On Jun 19, 2012, at 8:16 PM, "Chris Diehl" <[EMAIL PROTECTED]> wrote: > > > > > Hi All, > > > > > > I've yet to be able to successfully import the datetime module in a > > Jython > > > UDF when running my Pig script on our cluster. Having perused past > > message > > > traffic, it seems the answer was to put the jython.jar in > > /usr/lib/pig/lib. > > > That did not resolve the problem for me. I've tried both Jython 2.5 and > > > 2.5.2 with Pig 0.8. Any other standard steps I should be doing to get > > this > > > to work? > > > > > > Thanks, Chris > > > > > > Will Duckworth Senior Vice President, Software Engineering | comScore, > > Inc.(NASDAQ:SCOR) > > o +1 (703) 438-2108 | m +1 (301) 606-2977 | mailto: > [EMAIL PROTECTED] > > > > > ..................................................................................................... > > > > Introducing Mobile Metrix 2.0 - The next generation of mobile behavioral > > measurement > > www.comscore.com/MobileMetrix > > >
|
|