Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> this nested foreach worked in 0.8.1, no longer works in 0.10


Copy link to this message
-
this nested foreach worked in 0.8.1, no longer works in 0.10
We upgraded from Pig 0.8.1 to 0.10 and the following nested foreach no longer works:

actionBagGrouped = GROUP actionBag BY (deal_id,month);
dealCounts = FOREACH actionBagGrouped {
                sent = FILTER actionBag BY action=='sent';
                opened = FILTER actionBag BY action=='opened';
                clicked = FILTER actionBag BY action=='clicked';
                purchased = FILTER actionBag BY action=='purchased';

                GENERATE
                                FLATTEN(group),
                                COUNT(sent) AS sentCount,
                                COUNT(opened) AS openedCount,
                                COUNT(clicked) AS clickedCount,
                                COUNT(purchased) AS purchasedCount;
};
I get:
"Invalid scalar projection: action : A column needs to be projected from a relation for it to be used as a scalar"
Banging my head against a wall-the problem is with the nest op sent = Filter...

Help!
Thanks-
Steve