Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - this nested foreach worked in 0.8.1, no longer works in 0.10


Copy link to this message
-
RE: this nested foreach worked in 0.8.1, no longer works in 0.10
Steve Bernstein 2012-06-01, 17:25
No, all those relations embedded in the nested foreach are unique to it, not used elsewhere.
SB

-----Original Message-----
From: Dmitriy Ryaboy [mailto:[EMAIL PROTECTED]]
Sent: Friday, June 01, 2012 2:03 AM
To: [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Subject: Re: this nested foreach worked in 0.8.1, no longer works in 0.10

Do you have relations ned sent, opened, etc, elsewhere in the script?

On May 31, 2012, at 12:09 PM, Steve Bernstein <[EMAIL PROTECTED]> wrote:

> We upgraded from Pig 0.8.1 to 0.10 and the following nested foreach no longer works:
>
> actionBagGrouped = GROUP actionBag BY (deal_id,month); dealCounts =
> FOREACH actionBagGrouped {
>                sent = FILTER actionBag BY action=='sent';
>                opened = FILTER actionBag BY action=='opened';
>                clicked = FILTER actionBag BY action=='clicked';
>                purchased = FILTER actionBag BY action=='purchased';
>
>                GENERATE
>                                FLATTEN(group),
>                                COUNT(sent) AS sentCount,
>                                COUNT(opened) AS openedCount,
>                                COUNT(clicked) AS clickedCount,
>                                COUNT(purchased) AS purchasedCount; };
> I get:
> "Invalid scalar projection: action : A column needs to be projected from a relation for it to be used as a scalar"
> Banging my head against a wall-the problem is with the nest op sent = Filter...
>
> Help!
> Thanks-
> Steve