Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> MapTask.java -sort part


+
Samaneh Shokuhi 2013-04-21, 11:54
Copy link to this message
-
Re: MapTask.java -sort part
Note that the Reducer also does a merge sort over the acquired map
data; but am not sure if you looked there as well.

Mariappan's pointed JIRA (MAPREDUCE-4807) is already available in the
2.0.3+ releases out today and in the current branch-2. It would be
simpler to reuse that than do these modifications.

On Sun, Apr 21, 2013 at 5:24 PM, Samaneh Shokuhi
<[EMAIL PROTECTED]> wrote:
> Hi All,
> I have modified the MapTask.java file and tried to disable sort part for
> some reasons . I have removed this line
> *sorter.sort(MapOutputBuffer.this, kvstart, endPosition, reporter); *in
> sortAndSpill method but no changes seen in result. I have expected to get
> unsorted keys as mapper output but was not like that.
>
> My question is did i perform right action to disable sort or something else
> needs to be done ?
>
> Samaneh

--
Harsh J
+
Samaneh Shokuhi 2013-04-23, 08:30
+
Harsh J 2013-04-23, 08:49
+
Samaneh Shokuhi 2013-04-23, 09:11
+
Mariappan Asokan 2013-04-21, 12:32
+
Samaneh Shokuhi 2013-04-21, 14:53
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB