Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> "invalid stream header" UDF error after upgraded to pig 0.11.1


Copy link to this message
-
"invalid stream header" UDF error after upgraded to pig 0.11.1
Hi,

We have our Pig UDF working fine for 0.9.2.2, but after we upgraded to pig
0.11.1 and the pig job failed due to the following error.

at
org\.apache\.pig\.impl\.util\.ObjectSerializer\.deserialize(ObjectSerializer\.java:55)

at
org\.apache\.pig\.impl\.util\.UDFContext\.deserialize(UDFContext\.java:192)
at
org\.apache\.pig\.backend\.hadoop\.executionengine\.util\.MapRedUtil\.setupUDFContext(MapRedUtil\.java:159)

at
org\.apache\.pig\.backend\.hadoop\.executionengine\.mapReduceLayer\.PigOutputFormat\.setupUdfEnvAndStores(PigOutputFormat\.java:229)

at
org\.apache\.pig\.backend\.hadoop\.executionengine\.mapReduceLayer\.PigOutputFormat\.getOutputCommitter(PigOutputFormat\.java:275)

at org\.apache\.hadoop\.mapred\.Task\.initialize(Task\.java:515)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:358)
at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
at java\.security\.AccessController\.doPrivileged(Native Method)
at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
at
org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1132)

at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249)
Caused by: java\.io\.StreamCorruptedException: invalid stream header:
2DF52715
at
java\.io\.ObjectInputStream\.readStreamHeader(ObjectInputStream\.java:782)
at java\.io\.ObjectInputStream\.<init>(ObjectInputStream\.java:279)
at
org\.apache\.pig\.impl\.util\.ObjectSerializer\.deserialize(ObjectSerializer\.java:52)

Does anyone know what was wrong and how to resolve it?

Thanks,

John