Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - max 1 mapper per node


Copy link to this message
-
Re: max 1 mapper per node
Radim Kolar 2012-05-14, 15:10
Dne 10.5.2012 15:29, Robert Evans napsal(a):
> Yes adding in more resources in the scheduling request would be the
> ideal solution to the problem.  But sadly that is not a trivial change.
Best will be to have custom resources.

Example: in node config define that this node has:

1 x GPU
1 x Gbit Network
etc.

then add property to job configuration that this job needs 1 GPU. RM
will pickup node with free GPU.