Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> disable pipelining in Hadoop


Copy link to this message
-
Re: disable pipelining in Hadoop

(Removing common-dev, because this isn't a dev question.)

On Mar 1, 2011, at 6:13 AM, bikash sharma wrote:

> Hi,
> Is there a way to disable the use of pipelining , i.e., the reduce phase is
> started only after the map phase is completed?

Set mapred.reduce.slowstart.completed.maps to 1.

Be aware that you will introduce latency into the job.  Depending upon your use case, that may be acceptable.  See also https://issues.apache.org/jira/browse/MAPREDUCE-1184 .