Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Policies for placing a reducer


Copy link to this message
-
RE: Policies for placing a reducer
Devaraj k 2013-07-16, 07:04
Hi,

It doesn’t consider where the map’s ran to schedule the reducers because reducers need to contact all the mappers for the map o/p’s.  It schedules reducers wherever the slots available.

Thanks
Devaraj k

From: Felix.徐 [mailto:[EMAIL PROTECTED]]
Sent: 16 July 2013 09:25
To: [EMAIL PROTECTED]
Subject: Policies for placing a reducer

Hi all,

What is the policy of choosing a node for a reducer in mapreduce (Hadoop v1.2.0)?
For example,
If a cluster has 5 slaves, each slave can serve 2 maps and 2 reduces , there is a job who occupies 5 mappers and 3 reducers , how does the jobtracker assign reducers to these nodes (choosing free slaves or placing reducers close to mappers)?

Thanks.