Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Unable to load data using PigStorage that was previously stored using PigStorage


Copy link to this message
-
Unable to load data using PigStorage that was previously stored using PigStorage
Hi pig users,

I tried to load data using PigStorage that was previously stored using
PigStorage but it failed.

Each line looks like this in the data file that is generated by PigStorage:
[a#hello,b#{([c#11,d#22]),([c#33,d#44])}]

I did the following:
A = load 'data.txt' as document:[];
B = foreach A generate document#'b' as b;
C = foreach B generate flatten(b);
dump C;

I expect to see the following output:
([c#11,d#22])
([c#33,d#44])

Instead, I got:
java.lang.ClassCastException: org.apache.pig.data.DataByteArray cannot be
cast to org.apache.pig.data.DataBag

Anyone encounters this problem before? How can I read the data back?

Thanks,

Jerry