Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # user - pig generated 2 map-only jobs ?


+
Yang 2012-06-12, 06:21
Copy link to this message
-
Re: pig generated 2 map-only jobs ?
Alan Gates 2012-06-12, 21:14
There are cases where it would do this, such as unioning two inputs.  Can you send your script to the list?

Alan.

On Jun 11, 2012, at 11:21 PM, Yang wrote:

> this is what happened with my pig script.
> why would it generate 2 map-only jobs?
> wouldn't the optimization process chain together both mappers and keep only
> 1 mapper stage?
>
>
> thanks
> Yang
+
Yang 2012-06-17, 04:06
+
Alan Gates 2012-06-17, 06:51
+
Yang 2012-06-17, 16:39
+
Daniel Dai 2012-06-18, 02:00