Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> number of M/R jobs for a Pig Script


Copy link to this message
-
Re: number of M/R jobs for a Pig Script
Have you tried using ILLUSTRATE and EXPLAIN command? As far as I know, I
don't think they give you the exact number as it depends on the actual data
but I believe you can interpret it/extrapolate it from the information
provided by these commands.

Regards,
Shahab
On Tue, Oct 15, 2013 at 3:57 AM, ey-chih chow <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I have a Pig script that has two group-by statements on the the input data
> set.  Is there anybody knows how many M-R jobs the script will generate?
>  Thanks.
>
> Best regards,
>
> Ey-Chih Chow
>