Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> MapTask.java -sort part

Samaneh Shokuhi 2013-04-21, 11:54
Copy link to this message
Re: MapTask.java -sort part
Note that the Reducer also does a merge sort over the acquired map
data; but am not sure if you looked there as well.

Mariappan's pointed JIRA (MAPREDUCE-4807) is already available in the
2.0.3+ releases out today and in the current branch-2. It would be
simpler to reuse that than do these modifications.

On Sun, Apr 21, 2013 at 5:24 PM, Samaneh Shokuhi
> Hi All,
> I have modified the MapTask.java file and tried to disable sort part for
> some reasons . I have removed this line
> *sorter.sort(MapOutputBuffer.this, kvstart, endPosition, reporter); *in
> sortAndSpill method but no changes seen in result. I have expected to get
> unsorted keys as mapper output but was not like that.
> My question is did i perform right action to disable sort or something else
> needs to be done ?
> Samaneh

Harsh J
Samaneh Shokuhi 2013-04-23, 08:30
Harsh J 2013-04-23, 08:49
Samaneh Shokuhi 2013-04-23, 09:11
Mariappan Asokan 2013-04-21, 12:32
Samaneh Shokuhi 2013-04-21, 14:53