Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> "invalid stream header" UDF error after upgraded to pig 0.11.1


+
Jian Fang 2013-07-03, 21:34
Copy link to this message
-
Re: "invalid stream header" UDF error after upgraded to pig 0.11.1
Resend
On Wed, Jul 3, 2013 at 2:34 PM, Jian Fang <[EMAIL PROTECTED]>wrote:

> Hi,
>
> We have our Pig UDF working fine for 0.9.2.2, but after we upgraded to pig
> 0.11.1 and the pig job failed due to the following error.
>
> at
> org\.apache\.pig\.impl\.util\.ObjectSerializer\.deserialize(ObjectSerializer\.java:55)
>
> at
> org\.apache\.pig\.impl\.util\.UDFContext\.deserialize(UDFContext\.java:192)
> at
> org\.apache\.pig\.backend\.hadoop\.executionengine\.util\.MapRedUtil\.setupUDFContext(MapRedUtil\.java:159)
>
> at
> org\.apache\.pig\.backend\.hadoop\.executionengine\.mapReduceLayer\.PigOutputFormat\.setupUdfEnvAndStores(PigOutputFormat\.java:229)
>
> at
> org\.apache\.pig\.backend\.hadoop\.executionengine\.mapReduceLayer\.PigOutputFormat\.getOutputCommitter(PigOutputFormat\.java:275)
>
> at org\.apache\.hadoop\.mapred\.Task\.initialize(Task\.java:515)
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:358)
> at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
> at java\.security\.AccessController\.doPrivileged(Native Method)
> at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
> at
> org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1132)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249)
> Caused by: java\.io\.StreamCorruptedException: invalid stream header:
> 2DF52715
> at
> java\.io\.ObjectInputStream\.readStreamHeader(ObjectInputStream\.java:782)
> at java\.io\.ObjectInputStream\.<init>(ObjectInputStream\.java:279)
> at
> org\.apache\.pig\.impl\.util\.ObjectSerializer\.deserialize(ObjectSerializer\.java:52)
>
> Does anyone know what was wrong and how to resolve it?
>
> Thanks,
>
> John
>
+
Mark Wagner 2013-07-04, 00:57
+
Jian Fang 2013-07-04, 04:12
+
Jian Fang 2013-07-05, 17:34
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB