Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # user - Weird error moving from pig 0.6 to pig 0.8x, but fixed in 0.9x


Copy link to this message
-
Weird error moving from pig 0.6 to pig 0.8x, but fixed in 0.9x
Corbin Hoenes 2011-08-03, 18:00
I have a load that is causing a schema error.

images = LOAD 'imagelistsbysite' USING BinStorage() AS (site:chararray,
top_image_by_site:bag{image:chararray, cnt:long,
top_url_by_image:bag{url:chararray,title:chararray,cnt:long}});

Yields this error:
Caused by: org.apache.pig.impl.logicalLayer.schema.SchemaMergeException:
ERROR 1033: Schema size mismatch for merging schemas. Other schema size
greater than schema size. Schema: {(chararray,chararray,long)}. Other
schema: {url: chararray,title: chararray,cnt: long}

This has been working in pig 6 for a long time and doesn't work in pig 8 or
8.1.  Upgrading to pig 9 fixes the error apparently.  Does anyone know if
there was a JIRA on this issue?  Is there a way to side step the issue with
pig 8.1?