Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Pig and Avro Error


Copy link to this message
-
Pig and Avro Error
hi all,

Running pig with avro storage and facing the below issue

pig 0.10 and avro 1.7
*
*
*org.apache.avro.file.DataFileWriter$AppenderWriteException :
java.lang.RuntimeException : Dataum 23.0 is not in union ["null" , "int"]*
*
*
my pig script does the following

a = load '/user/abhi/abc.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

b = load '/user/abhi/def.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

joined = join a  by $0 left outer , b by $0;

final = foreach joined generate
{
...
...
};

store final into '/user/abhi/output' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

Thanks
abhishek
+
Cheolsoo Park 2013-06-09, 19:26
+
abhishek dodda 2013-06-09, 19:30
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB