Uddipan Mukherjee 2012-11-01, 07:41
kapil bhosale 2012-11-01, 07:51
Kartashov, Andy 2012-11-01, 20:22
The number of map/reduce tasks slots on your cluster is the sum of all the
slots from your TaskTracker nodes. Based on your node's resource
availability you can even configure that on a per node basis. The slots are
defined on a node level using the following properties
As Kapil mentioned the total number of slots across the cluster can be
obtained from JT web UI.
The other 3 properties can be defined on a job level. However in production
clustes the jvm size is marked final to prevent abuses that may lead to
The jvm size of task jvms are defined by 'mapred.child.java.opts' which
defaults to 200 Mb and the jvm reuse is defined by
'mapred.job.reuse.jvm.num.tasks' which defaults to 1 task per jvm.
Michael Segel 2012-11-01, 12:44