-Re: disable pipelining in Hadoop
Allen Wittenauer 2011-03-12, 16:32
(Removing common-dev, because this isn't a dev question.)
On Mar 1, 2011, at 6:13 AM, bikash sharma wrote:
> Is there a way to disable the use of pipelining , i.e., the reduce phase is
> started only after the map phase is completed?
Set mapred.reduce.slowstart.completed.maps to 1.
Be aware that you will introduce latency into the job. Depending upon your use case, that may be acceptable. See also https://issues.apache.org/jira/browse/MAPREDUCE-1184 .