Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # user - "invalid stream header" UDF error after upgraded to pig 0.11.1


Copy link to this message
-
"invalid stream header" UDF error after upgraded to pig 0.11.1
Jian Fang 2013-07-03, 21:34
Hi,

We have our Pig UDF working fine for 0.9.2.2, but after we upgraded to pig
0.11.1 and the pig job failed due to the following error.

at
org\.apache\.pig\.impl\.util\.ObjectSerializer\.deserialize(ObjectSerializer\.java:55)

at
org\.apache\.pig\.impl\.util\.UDFContext\.deserialize(UDFContext\.java:192)
at
org\.apache\.pig\.backend\.hadoop\.executionengine\.util\.MapRedUtil\.setupUDFContext(MapRedUtil\.java:159)

at
org\.apache\.pig\.backend\.hadoop\.executionengine\.mapReduceLayer\.PigOutputFormat\.setupUdfEnvAndStores(PigOutputFormat\.java:229)

at
org\.apache\.pig\.backend\.hadoop\.executionengine\.mapReduceLayer\.PigOutputFormat\.getOutputCommitter(PigOutputFormat\.java:275)

at org\.apache\.hadoop\.mapred\.Task\.initialize(Task\.java:515)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:358)
at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
at java\.security\.AccessController\.doPrivileged(Native Method)
at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
at
org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1132)

at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249)
Caused by: java\.io\.StreamCorruptedException: invalid stream header:
2DF52715
at
java\.io\.ObjectInputStream\.readStreamHeader(ObjectInputStream\.java:782)
at java\.io\.ObjectInputStream\.<init>(ObjectInputStream\.java:279)
at
org\.apache\.pig\.impl\.util\.ObjectSerializer\.deserialize(ObjectSerializer\.java:52)

Does anyone know what was wrong and how to resolve it?

Thanks,

John
+
Jian Fang 2013-07-03, 22:15
+
Mark Wagner 2013-07-04, 00:57
+
Jian Fang 2013-07-04, 04:12
+
Jian Fang 2013-07-05, 17:34