Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Pig GROUP operator - Data is shuffled and wind up together for the same grouping key


Copy link to this message
-
Pig GROUP operator - Data is shuffled and wind up together for the same grouping key
Hi,

I'm using pig version 0.11.0

While using GROUP operator in Pig all the data is shuffled, so that rows in
different partitions that have the same grouping key wind up together and
got wrong results for grouping.

While storing the result data, it is share work between multiple
calculations.

How to solve this? Please advice.

--
Regards,
Viswa.J
+
Prashant Kommireddi 2013-08-29, 17:02