Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> max 1 mapper per node


+
Radim Kolar 2012-04-26, 17:56
+
Robert Evans 2012-04-26, 18:07
+
Radim Kolar 2012-04-27, 05:38
+
Robert Evans 2012-04-27, 15:30
+
Radim Kolar 2012-05-03, 09:19
+
Radim Kolar 2012-05-03, 12:59
Copy link to this message
-
Re: max 1 mapper per node
We've been against these 'features' since it leads to very bad behaviour across the cluster with multiple apps/users etc.

What is your use-case i.e. what are you trying to achieve with this?

thanks,
Arun

On May 3, 2012, at 5:59 AM, Radim Kolar wrote:

> if plugin system for AM is overkill, something simpler can be made like:
>
> maximum number of mappers per node
> maximum number of reducers per node
>
> maximum percentage of non data local tasks
> maximum percentage of rack local tasks
>
> and set this in job properties.

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
+
Jeffrey Buell 2012-05-09, 19:36
+
Arun C Murthy 2012-05-10, 20:26
+
Jeffrey Buell 2012-05-10, 22:40
+
Radim Kolar 2012-05-10, 11:56
+
GUOJUN Zhu 2012-05-10, 12:53
+
Robert Evans 2012-05-10, 13:29
+
Radim Kolar 2012-05-14, 15:10
+
Robert Evans 2012-05-09, 16:10