Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - mapred.tasktracker.map.tasks.maximum

Copy link to this message
Mark Kerzner 2012-11-13, 15:16

I have a cluster with 4 nodes and 32 many cores on each. My default value
for the maximum number of mappers per slot is 1:

    <!-- see other kb entry about this one. -->
(which I think is wrong).

Howeve, when sizable jobs run, I see 65 mappers working, so it seems that
it does create more than 1 mapper per node.

Questions: what maximum number of mappers would be appropriate in this
situation? Is that the right way to set them?

Thank you. Sincerely,