Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Policies for placing a reducer


Copy link to this message
-
RE: Policies for placing a reducer
Hi,

It doesn’t consider where the map’s ran to schedule the reducers because reducers need to contact all the mappers for the map o/p’s.  It schedules reducers wherever the slots available.

Thanks
Devaraj k

From: Felix.徐 [mailto:[EMAIL PROTECTED]]
Sent: 16 July 2013 09:25
To: [EMAIL PROTECTED]
Subject: Policies for placing a reducer

Hi all,

What is the policy of choosing a node for a reducer in mapreduce (Hadoop v1.2.0)?
For example,
If a cluster has 5 slaves, each slave can serve 2 maps and 2 reduces , there is a job who occupies 5 mappers and 3 reducers , how does the jobtracker assign reducers to these nodes (choosing free slaves or placing reducers close to mappers)?

Thanks.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB