Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Weird error moving from pig 0.6 to pig 0.8x, but fixed in 0.9x


Copy link to this message
-
Weird error moving from pig 0.6 to pig 0.8x, but fixed in 0.9x
I have a load that is causing a schema error.

images = LOAD 'imagelistsbysite' USING BinStorage() AS (site:chararray,
top_image_by_site:bag{image:chararray, cnt:long,
top_url_by_image:bag{url:chararray,title:chararray,cnt:long}});

Yields this error:
Caused by: org.apache.pig.impl.logicalLayer.schema.SchemaMergeException:
ERROR 1033: Schema size mismatch for merging schemas. Other schema size
greater than schema size. Schema: {(chararray,chararray,long)}. Other
schema: {url: chararray,title: chararray,cnt: long}

This has been working in pig 6 for a long time and doesn't work in pig 8 or
8.1.  Upgrading to pig 9 fixes the error apparently.  Does anyone know if
there was a JIRA on this issue?  Is there a way to side step the issue with
pig 8.1?
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB