Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - ERROR: String cannot be cast to org.apache.pig.data.Tuple


Copy link to this message
-
RE: ERROR: String cannot be cast to org.apache.pig.data.Tuple
william.dowling@... 2011-05-06, 22:05
In case anyone comes across this ...

This problem went away when I fixed a define ... ship(...)

to make sure that the file I was shipping was accessible from the running environment on the non-local
cluster.
William F Dowling
Sr Technical Specialist, Software Engineering
Thomson Reuters
0 +1 215 823 3853

-----Original Message-----
From: Dowling, William (Professional)
Sent: Friday, May 06, 2011 4:17 PM
To: [EMAIL PROTECTED]
Subject: ERROR: String cannot be cast to org.apache.pig.data.Tuple

I have a pig script that is tested and working in local mode.  But when I try to run it in mapreduce mode on a non-local hadoop cluster I get an error with this stack trace:

ERROR 2999: Unexpected internal error. java.lang.String cannot be cast to org.apache.pig.data.Tuple

java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.Tuple
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.getNext(POSplit.java:220)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:237)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:232)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)

I’m using pig 0.8.1. Locally I have hadoop 0.20.2; the remote cluster has Hadoop 0.20.2+320.

Has anyone seen this before?  Any suggestions on how to track it down?
Thanks,

Will
William F Dowling
Sr Technical Specialist, Software Engineering
Thomson Reuters
0 +1 215 823 3853