Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> max 1 mapper per node


Copy link to this message
-
Re: max 1 mapper per node
Dne 10.5.2012 15:29, Robert Evans napsal(a):
> Yes adding in more resources in the scheduling request would be the
> ideal solution to the problem.  But sadly that is not a trivial change.
Best will be to have custom resources.

Example: in node config define that this node has:

1 x GPU
1 x Gbit Network
etc.

then add property to job configuration that this job needs 1 GPU. RM
will pickup node with free GPU.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB