Hi All,

I recently downloaded and installed Pig 0.10 on our Hadoop cluster. After
configuring things as I've done before to use Jython UDFs, I'm seeing
deserialization errors. I've verified that my test code runs when I switch
back to Pig 0.8. I'm successfully using Pig 0.10 with Jython on my MacBook
Pro in local mode so I'm rather flummoxed as to what is up.

What I've done to set up Pig 0.10 for using Jython UDFs:
1) Installed Jython 2.5.0
2) set PIG_CLASSPATH="<jython path>/jython.jar"
3) set JYTHON_HOME="<jython path>"
4) added <jython path>/bin to the path
5) put jython-2.5.0.jar into <pig path>/lib for good measure

I'm not sure how to get around this issue. Anyone have any suggestions? In
case it's illuminating, I've returned output from a very simple Pig job
that loads data and attempts to pass it through a Jython UDF.

Chris

2012-06-08 19:25:16,031 [main] INFO  org.apache.pig.Main - Apache Pig
version 0.10.0 (r1328203) compiled Apr 19 2012, 22:54:12
2012-06-08 19:25:16,032 [main] INFO  org.apache.pig.Main - Logging error
messages to:
/opt/shared_storage/log_analysis_pig_python_scripts/pig_1339183516027.log
2012-06-08 19:25:18,506 [main] INFO
 org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to hadoop file system at: hdfs://X
2012-06-08 19:25:19,222 [main] INFO
 org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to map-reduce job tracker at: X
2012-06-08 19:25:21,153 [main] INFO
 org.apache.pig.scripting.jython.JythonScriptEngine - created tmp
python.cachedir=/tmp/pig_jython_491028285262723042
*sys-package-mgr*: processing new jar, '/usr/java/jdk1.6.0_21/lib/tools.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/hadoop-core-0.20.2-cdh3u1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/ant-contrib-1.0b3.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/aspectjrt-1.6.5.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/aspectjtools-1.6.5.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/commons-cli-1.2.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/commons-codec-1.4.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/commons-daemon-1.0.1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/commons-el-1.0.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/commons-httpclient-3.0.1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/commons-logging-1.0.4.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/commons-logging-api-1.0.4.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/commons-net-1.4.1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/core-3.1.1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/hadoop-fairscheduler-0.20.2-cdh3u1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/hsqldb-1.8.0.10.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jackson-core-asl-1.5.2.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jackson-mapper-asl-1.5.2.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jasper-compiler-5.5.12.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jasper-runtime-5.5.12.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jets3t-0.6.1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jetty-6.1.26.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jetty-servlet-tester-6.1.26.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jetty-util-6.1.26.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jsch-0.1.42.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/junit-4.5.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/kfs-0.2.2.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/log4j-1.2.15.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/mockito-all-1.8.2.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/oro-2.0.8.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/servlet-api-2.5-20081211.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/servlet-api-2.5-6.1.14.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/slf4j-api-1.4.3.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/slf4j-log4j12-1.4.3.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/xmlenc-0.52.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-2.1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-api-2.1.jar'
*sys-package-mgr*: processing new jar,
'/usr/lib/hadoop-0.20/contrib/fairscheduler/hadoop-fairscheduler-0.20.2-cdh3u1.jar'
*sys-package-mgr*: processing new jar,
'/opt/shared_storage/jython_2.5.0/jython.jar'
*sys-package-mgr*: processing new jar,
'/opt/shared_storage/pig-0.10.0/lib/automaton.jar'
*sys-package-mgr*: processing new jar,
'/opt/shared_storage/pig-0.10.0/lib/jython-2.5.0.jar'
*sys-package-mgr*: processing new jar,
'/opt/shared_storage/pig-0.10.0/pig-0.10.0-withouthadoop.jar'
*sys-package-mgr*: processing new jar,
'/usr/java/jdk1.6.0_21/jre/lib/resources.jar'
*sys-package-mgr*: processing new jar,
'/usr/java/jdk1.6.0_21/jre/lib/rt.jar'
*sys-package-mgr*: processing new jar,
'/usr/java/jdk1.6.0_21/jre/lib/jsse.jar'
*sys-package-mgr*: processing new jar,
'/usr/java/jdk1.6.0_21/jre/lib/jce.jar'
*sys-package-mgr*: processing new jar,
'/usr/java/jdk1.6.0_21/jre/lib/charsets.jar'
*sys-package-mgr*: processing new jar,
'/usr/java/jdk1.6.0_21/jre/lib/ext/sunjce_provider.jar'
*sys-package-mgr*: processing new jar,
'/usr/java/jdk1.6.0_21/jre/lib/ext/localedata.jar'
*sys-package-mgr*: processing new jar,
'/usr/java/jdk1.6.0_21/jre/lib/e

Chris,

I can confirm the problem; just run into it myself :(

In my case I was able to run my code succesfully on MapR cluster (hadoop
0.20.2), with Pig 0.9.1 and Jython 2.5.2.
Now, I am getting same "Deserialization error" after upgrading to Pig 0.10.0
(see log snippets below).

Any ideas/luck so far? Is there anything I can try/test to help?

Marek

-----------------
2012-06-19 16:24:54,470 [main] INFO  org.apache.pig.Main - Apache Pig
version 0.10.0 (r1328203) compiled Apr 20 2012, 05:54:07
2012-06-19 16:24:54,470 [main] INFO  org.apache.pig.Main - Logging error
messages to: /transfer/marek/poc123-code/pig_1340141094466.log
(...)
2012-06-19 16:26:27,484 [main] ERROR
org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
2012-06-19 16:26:27,488 [main] INFO
org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:

HadoopVersion   PigVersion      UserId  StartedAt               FinishedAt
Features
0.20.2-dev      0.10.0          marek   2012-06-19 16:25:13     2012-06-19
16:26:27     FILTER

Failed!
(...)

2012-06-19 16:26:27,488 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLaunch
er - Failed!
2012-06-19 16:26:27,544 [main] ERROR org.apache.pig.tools.grunt.GruntParser
- ERROR 2997: Unable to recreate exception from backed error:
java.io.IOException: Deserialization error: could not instantiate
'org.apache.pig.scripting.jython.JythonFunction' with arguments
'[/transfer/marek/poc123-code/poc123-udf.py, parse_time_local]'
        at
org.apache.pig.impl.util.ObjectSerializer.deserialize(ObjectSerializer.java:
55)
        at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBa
se.setup(PigGenericMapBase.java:177)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:654)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
va:1109)
        at org.apache.hadoop.mapred.Child.main(Child.java:264)
Caused by: java.lang.RuntimeException: could not instantiate
'org.apache.pig.scripting.jython.JythonFunction' with arguments
'[/transfer/marek/poc123-code/poc123-udf.py, parse_time_local]'
        at
org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:553)
        at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperat
ors.POUserFunc.instantiateFunc(POUserFunc.java:107)
        at
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperat
ors.POUserFunc.readObject(POUserFunc.java:439)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:969)
        at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1848)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1752)
        at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1328)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:350)
        at java.util.ArrayList.readObject(ArrayList.java:593)
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:969)
        at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1848)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1752)
        at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1328)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:350)
        at java.util.HashMap.readObject(HashMap.java:1030)
        at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:969)
        at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1848)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1752)
        at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1328)
        at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1946)
        at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1870)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1752)
        at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1328)
        at
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1946)
        at
java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1870)
        at
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1752)
        at
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1328)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:350)
        at java.util.ArrayList.readObject(ArrayList.java:593)
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:969)
        at
java.io.Obje

Hi Marek,

I wish I could offer a solution. I tried all sorts of permutations and to
no avail. I retreated back to our base install of Pig 0.8 where Jython UDFs
work for me.
Here's a list of things I've tried:

1) Setting JYTHON_HOME to the Jython path
2) Setting PIG_CLASSPATH to <Jython path>/jython.jar
3) Copying jython.jar to <Pig path>/lib
4) Using Jython 2.5.0 and 2.5.2

I can't afford to burn any more time right now looking into this. I'm
hoping the problem can be uncovered. Jython UDF support is critical for my
productivity.

Chris

On Tue, Jun 19, 2012 at 2:40 PM, Marek Dudek <[EMAIL PROTECTED]>wrote:

> Chris,
>
> I can confirm the problem; just run into it myself :(
>
> In my case I was able to run my code succesfully on MapR cluster (hadoop
> 0.20.2), with Pig 0.9.1 and Jython 2.5.2.
> Now, I am getting same "Deserialization error" after upgrading to Pig
> 0.10.0
> (see log snippets below).
>
> Any ideas/luck so far? Is there anything I can try/test to help?
>
> Marek
>
>
>
> -----------------
> 2012-06-19 16:24:54,470 [main] INFO  org.apache.pig.Main - Apache Pig
> version 0.10.0 (r1328203) compiled Apr 20 2012, 05:54:07
> 2012-06-19 16:24:54,470 [main] INFO  org.apache.pig.Main - Logging error
> messages to: /transfer/marek/poc123-code/pig_1340141094466.log
> (...)
> 2012-06-19 16:26:27,484 [main] ERROR
> org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
> 2012-06-19 16:26:27,488 [main] INFO
> org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
>
> HadoopVersion   PigVersion      UserId  StartedAt               FinishedAt
> Features
> 0.20.2-dev      0.10.0          marek   2012-06-19 16:25:13     2012-06-19
> 16:26:27     FILTER
>
> Failed!
> (...)
>
> 2012-06-19 16:26:27,488 [main] INFO
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLaunch
> er - Failed!
> 2012-06-19 16:26:27,544 [main] ERROR org.apache.pig.tools.grunt.GruntParser
> - ERROR 2997: Unable to recreate exception from backed error:
> java.io.IOException: Deserialization error: could not instantiate
> 'org.apache.pig.scripting.jython.JythonFunction' with arguments
> '[/transfer/marek/poc123-code/poc123-udf.py, parse_time_local]'
>        at
>
> org.apache.pig.impl.util.ObjectSerializer.deserialize(ObjectSerializer.java:
> 55)
>        at
>
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBa
> se.setup(PigGenericMapBase.java:177)
>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:654)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
>        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at javax.security.auth.Subject.doAs(Subject.java:396)
>        at
>
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
> va:1109)
>        at org.apache.hadoop.mapred.Child.main(Child.java:264)
> Caused by: java.lang.RuntimeException: could not instantiate
> 'org.apache.pig.scripting.jython.JythonFunction' with arguments
> '[/transfer/marek/poc123-code/poc123-udf.py, parse_time_local]'
>        at
> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:553)
>        at
>
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperat
> ors.POUserFunc.instantiateFunc(POUserFunc.java:107)
>        at
>
> org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperat
> ors.POUserFunc.readObject(POUserFunc.java:439)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
> )
>        at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
> .java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:969)

Hi,

- ERROR 2997: Unable to recreate exception from backed error:
> java.io.IOException: Deserialization error: could not instantiate
> 'org.apache.pig.scripting.jython.JythonFunction' with arguments

'[/transfer/marek/poc123-code/poc123-udf.py, parse_time_local]'
This is a bug in Pig-0.10. Please refer to PIg-2761 and its related jiras:

https://issues.apache.org/jira/browse/PIG-2761
https://issues.apache.org/jira/browse/PIG-2745

Thanks,
Cheolsoo

On Tue, Jun 19, 2012 at 4:28 PM, Chris Diehl <[EMAIL PROTECTED]> wrote:

> Hi Marek,
>
> I wish I could offer a solution. I tried all sorts of permutations and to
> no avail. I retreated back to our base install of Pig 0.8 where Jython UDFs
> work for me.
> Here's a list of things I've tried:
>
> 1) Setting JYTHON_HOME to the Jython path
> 2) Setting PIG_CLASSPATH to <Jython path>/jython.jar
> 3) Copying jython.jar to <Pig path>/lib
> 4) Using Jython 2.5.0 and 2.5.2
>
> I can't afford to burn any more time right now looking into this. I'm
> hoping the problem can be uncovered. Jython UDF support is critical for my
> productivity.
>
> Chris
>
> On Tue, Jun 19, 2012 at 2:40 PM, Marek Dudek <[EMAIL PROTECTED]
> >wrote:
>
> > Chris,
> >
> > I can confirm the problem; just run into it myself :(
> >
> > In my case I was able to run my code succesfully on MapR cluster (hadoop
> > 0.20.2), with Pig 0.9.1 and Jython 2.5.2.
> > Now, I am getting same "Deserialization error" after upgrading to Pig
> > 0.10.0
> > (see log snippets below).
> >
> > Any ideas/luck so far? Is there anything I can try/test to help?
> >
> > Marek
> >
> >
> >
> > -----------------
> > 2012-06-19 16:24:54,470 [main] INFO  org.apache.pig.Main - Apache Pig
> > version 0.10.0 (r1328203) compiled Apr 20 2012, 05:54:07
> > 2012-06-19 16:24:54,470 [main] INFO  org.apache.pig.Main - Logging error
> > messages to: /transfer/marek/poc123-code/pig_1340141094466.log
> > (...)
> > 2012-06-19 16:26:27,484 [main] ERROR
> > org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
> > 2012-06-19 16:26:27,488 [main] INFO
> > org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
> >
> > HadoopVersion   PigVersion      UserId  StartedAt
> FinishedAt
> > Features
> > 0.20.2-dev      0.10.0          marek   2012-06-19 16:25:13
> 2012-06-19
> > 16:26:27     FILTER
> >
> > Failed!
> > (...)
> >
> > 2012-06-19 16:26:27,488 [main] INFO
> >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLaunch
> > er - Failed!
> > 2012-06-19 16:26:27,544 [main] ERROR
> org.apache.pig.tools.grunt.GruntParser
> > - ERROR 2997: Unable to recreate exception from backed error:
> > java.io.IOException: Deserialization error: could not instantiate
> > 'org.apache.pig.scripting.jython.JythonFunction' with arguments
> > '[/transfer/marek/poc123-code/poc123-udf.py, parse_time_local]'
> >        at
> >
> >
> org.apache.pig.impl.util.ObjectSerializer.deserialize(ObjectSerializer.java:
> > 55)
> >        at
> >
> >
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBa
> > se.setup(PigGenericMapBase.java:177)
> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
> >        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:654)
> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
> >        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
> >        at java.security.AccessController.doPrivileged(Native Method)
> >        at javax.security.auth.Subject.doAs(Subject.java:396)
> >        at
> >
> >
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
> > va:1109)
> >        at org.apache.hadoop.mapred.Child.main(Child.java:264)
> > Caused by: java.lang.RuntimeException: could not instantiate
> > 'org.apache.pig.scripting.jython.JythonFunction' with arguments
> > '[/transfer/marek/poc123-code/poc123-udf.py, parse_time_local]'
> >        at
> >
> org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:553)