Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> UNION with bytearray


Copy link to this message
-
Re: UNION with bytearray
This sounds like a bug.

What do you have after the union ?
Can you try to reproduce this with a script/data that you can share ?
If you can open a jira with details, that would be even better.

Thanks,
Thejas
On 9/4/12 8:52 AM, Xavier Stevens wrote:
> I'm trying to do a UNION on two datasets with identical schemas
> (k:bytearray, v:chararray). When using the UNION operator like so:
>
> combined_data = UNION dataset1, dataset2;
>
> I get the following error:
>
> java.lang.RuntimeException: Unexpected data type java.util.ArrayList
> found in stream. Note only standard Pig type is supported when you
> output from UDF/LoadFunc
>
> Everything works fine if I store the two datasets separately without the
> union.
>
> This feels like a bug, but am I doing something wrong here?
>
> Cheers,
>
>
> -Xavier
>