Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - How to Influence Reduce Task Location.

Copy link to this message
Re: How to Influence Reduce Task Location.
Allen Wittenauer 2010-12-19, 23:59

On Dec 19, 2010, at 10:23 AM, Jane Chen wrote:

> Suppose that the output is written to a database, that only runs on certain nodes.  It will be desirable to schedule the reducer tasks to run on the nodes local or close to the database nodes.
a) That's a side-effect--pretty much "against the rules".  Very little support is provided for such things.

b) At a minimum, you'll need to write your own scheduler.