Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> disable pipelining in Hadoop


Copy link to this message
-
Re: disable pipelining in Hadoop

(Removing common-dev, because this isn't a dev question.)

On Mar 1, 2011, at 6:13 AM, bikash sharma wrote:

> Hi,
> Is there a way to disable the use of pipelining , i.e., the reduce phase is
> started only after the map phase is completed?

Set mapred.reduce.slowstart.completed.maps to 1.

Be aware that you will introduce latency into the job.  Depending upon your use case, that may be acceptable.  See also https://issues.apache.org/jira/browse/MAPREDUCE-1184 .
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB