Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> sorting mechanism


+
Samaneh Shokuhi 2012-09-30, 19:06
Copy link to this message
-
Re: sorting mechanism
Look at MapTask.java (MapOutputBuffer) and ReduceTask.java and follow the merge code.

Arun

On Sep 30, 2012, at 12:06 PM, Samaneh Shokuhi wrote:

> Hi,
> I want to know about the sorting mechanism in mapper and reducer,As i
> understood from document the result from mapper get sorted before sent to
> reducer.
> Could you please tell me which  part of hadoop implementation is
> responsible for this sort.
>
> Also please let me know which classes are responsible for sorting in
> reducer phase.
>
> Best Regards,
> Samaneh

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB