Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> pig generated 2 map-only jobs ?


+
Yang 2012-06-12, 06:21
Copy link to this message
-
Re: pig generated 2 map-only jobs ?
There are cases where it would do this, such as unioning two inputs.  Can you send your script to the list?

Alan.

On Jun 11, 2012, at 11:21 PM, Yang wrote:

> this is what happened with my pig script.
> why would it generate 2 map-only jobs?
> wouldn't the optimization process chain together both mappers and keep only
> 1 mapper stage?
>
>
> thanks
> Yang
+
Yang 2012-06-17, 04:06
+
Alan Gates 2012-06-17, 06:51
+
Yang 2012-06-17, 16:39
+
Daniel Dai 2012-06-18, 02:00
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB