Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - max 1 mapper per node


Copy link to this message
-
Re: max 1 mapper per node
Radim Kolar 2012-05-03, 09:19
Dne 27.4.2012 17:30, Robert Evans napsal(a):
> Radim,
>
> You would want to modify the application master for this, and it is
> likely to be a bit of a hack because the RM scheduler itself is not
> really designed for this.
What about to do something like this:
  In job JAR there will be loadable plugin which will be loaded by AM
and used for allocating containers. For example mapreduce job should
request to launch only data-local tasks or do some other customization.