Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> how to know which part of the explain plan my MR job is running?


Copy link to this message
-
Re: how to know which part of the explain plan my MR job is running?
>From the JT you can open the job confs and search for pig.alias and
pig.feature (from memory).

Or you can start you pig script with Ambrose, which will launch a web UI
that shows script progress wrt the various jobs.

http://github.com/twitter/ambrose

On Sunday, June 24, 2012, Yang wrote:

> now my pig script is stuck at one of the MR jobs, in reduce stage,
> it stayed in reducing state for 30minutes without much progress.
>
> now, to debug this, how could I determine which part of the explain plan
> represents
> this MR job?
>
>
> Thanks!
> Yang
>
--
Sent from Gmail Mobile