Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> max 1 mapper per node

Copy link to this message
Re: max 1 mapper per node
We've been against these 'features' since it leads to very bad behaviour across the cluster with multiple apps/users etc.

What is your use-case i.e. what are you trying to achieve with this?


On May 3, 2012, at 5:59 AM, Radim Kolar wrote:

> if plugin system for AM is overkill, something simpler can be made like:
> maximum number of mappers per node
> maximum number of reducers per node
> maximum percentage of non data local tasks
> maximum percentage of rack local tasks
> and set this in job properties.

Arun C. Murthy
Hortonworks Inc.