Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # user - Pig and Avro Error


Copy link to this message
-
Pig and Avro Error
abhishek dodda 2013-06-09, 18:01
hi all,

Running pig with avro storage and facing the below issue

pig 0.10 and avro 1.7
*
*
*org.apache.avro.file.DataFileWriter$AppenderWriteException :
java.lang.RuntimeException : Dataum 23.0 is not in union ["null" , "int"]*
*
*
my pig script does the following

a = load '/user/abhi/abc.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

b = load '/user/abhi/def.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

joined = join a  by $0 left outer , b by $0;

final = foreach joined generate
{
...
...
};

store final into '/user/abhi/output' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

Thanks
abhishek
+
Cheolsoo Park 2013-06-09, 19:26
+
abhishek dodda 2013-06-09, 19:30