Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> max 1 mapper per node


+
Radim Kolar 2012-04-26, 17:56
+
Robert Evans 2012-04-26, 18:07
+
Radim Kolar 2012-04-27, 05:38
+
Robert Evans 2012-04-27, 15:30
+
Radim Kolar 2012-05-03, 09:19
+
Radim Kolar 2012-05-03, 12:59
Copy link to this message
-
Re: max 1 mapper per node
We've been against these 'features' since it leads to very bad behaviour across the cluster with multiple apps/users etc.

What is your use-case i.e. what are you trying to achieve with this?

thanks,
Arun

On May 3, 2012, at 5:59 AM, Radim Kolar wrote:

> if plugin system for AM is overkill, something simpler can be made like:
>
> maximum number of mappers per node
> maximum number of reducers per node
>
> maximum percentage of non data local tasks
> maximum percentage of rack local tasks
>
> and set this in job properties.

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
+
Jeffrey Buell 2012-05-09, 19:36
+
Arun C Murthy 2012-05-10, 20:26
+
Jeffrey Buell 2012-05-10, 22:40
+
Radim Kolar 2012-05-10, 11:56
+
GUOJUN Zhu 2012-05-10, 12:53
+
Robert Evans 2012-05-10, 13:29
+
Radim Kolar 2012-05-14, 15:10
+
Robert Evans 2012-05-09, 16:10
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB