Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Number of map tasks spawned


Copy link to this message
-
Number of map tasks spawned

Hi,

The MapReduce tutorial specifies that

 >> The Hadoop Map/Reduce framework spawns one map task for each
InputSplit generated by the InputFormat for the job.

But, the mapred.map.tasks definition is

 >> The default number of map tasks per job. Ignored when
mapred.job.tracker is "local".

So, is the number of map tasks spawned based on the number of
InputSplits generated or based on the mapred.map.tasks value specified
in the configuration file?

Thanks,
Praveen
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB