Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> number of M/R jobs for a Pig Script

Copy link to this message
Re: number of M/R jobs for a Pig Script
Have you tried using ILLUSTRATE and EXPLAIN command? As far as I know, I
don't think they give you the exact number as it depends on the actual data
but I believe you can interpret it/extrapolate it from the information
provided by these commands.

On Tue, Oct 15, 2013 at 3:57 AM, ey-chih chow <[EMAIL PROTECTED]> wrote:

> Hi,
> I have a Pig script that has two group-by statements on the the input data
> set.  Is there anybody knows how many M-R jobs the script will generate?
>  Thanks.
> Best regards,
> Ey-Chih Chow