Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Cross product bug pig 0.10?

Copy link to this message
Re: Cross product bug pig 0.10?
I'll try to do that with as simple an example as possible. I ran into this
problem in 2 independent scripts.

On 5/21/13 1:41 AM, "Jonathan Coveney" <[EMAIL PROTECTED]> wrote:

>Any chance you could replicate this for us? Ideally some dummy data and a
>2013/5/19 Mehmet Tepedelenlioglu <[EMAIL PROTECTED]>
>> Hi,
>> Recently I was taking the cross product between 2 bags of tuples one of
>> which has only one tuple, to append the one with one element to all the
>> others (I know this is not the best way to do this, it was done as a
>> prototype). There seems to be a bug with the cross product where not all
>> the
>> tuples of the larger bag are replicated. All but one of the part files
>> empty, and everything works just fine in the local mode (probably
>> it
>> uses only one reducer). Is anybody else aware of this issue?
>> The version is:
>> Apache Pig version 0.10.0-cdh4.1.2 (rexported)
>> compiled Nov 01 2012, 18:38:33
>> Thanks,
>> Mehmet