Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Pig and Avro Error


Copy link to this message
-
Pig and Avro Error
hi all,

Running pig with avro storage and facing the below issue

pig 0.10 and avro 1.7
*
*
*org.apache.avro.file.DataFileWriter$AppenderWriteException :
java.lang.RuntimeException : Dataum 23.0 is not in union ["null" , "int"]*
*
*
my pig script does the following

a = load '/user/abhi/abc.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

b = load '/user/abhi/def.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

joined = join a  by $0 left outer , b by $0;

final = foreach joined generate
{
...
...
};

store final into '/user/abhi/output' using
org.apache.pig.piggybank.storage.avro.AvroStorage();

Thanks
abhishek
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB