Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> ERROR: String cannot be cast to org.apache.pig.data.Tuple


Copy link to this message
-
RE: ERROR: String cannot be cast to org.apache.pig.data.Tuple
In case anyone comes across this ...

This problem went away when I fixed a define ... ship(...)

to make sure that the file I was shipping was accessible from the running environment on the non-local
cluster.
William F Dowling
Sr Technical Specialist, Software Engineering
Thomson Reuters
0 +1 215 823 3853

-----Original Message-----
From: Dowling, William (Professional)
Sent: Friday, May 06, 2011 4:17 PM
To: [EMAIL PROTECTED]
Subject: ERROR: String cannot be cast to org.apache.pig.data.Tuple

I have a pig script that is tested and working in local mode.  But when I try to run it in mapreduce mode on a non-local hadoop cluster I get an error with this stack trace:

ERROR 2999: Unexpected internal error. java.lang.String cannot be cast to org.apache.pig.data.Tuple

java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.Tuple
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.getNext(POSplit.java:220)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:237)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:232)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)

I’m using pig 0.8.1. Locally I have hadoop 0.20.2; the remote cluster has Hadoop 0.20.2+320.

Has anyone seen this before?  Any suggestions on how to track it down?
Thanks,

Will
William F Dowling
Sr Technical Specialist, Software Engineering
Thomson Reuters
0 +1 215 823 3853
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB