|
|
-
Number of map tasks spawned
Praveen Sripati 2010-04-25, 10:58
Hi,
The MapReduce tutorial specifies that
>> The Hadoop Map/Reduce framework spawns one map task for each InputSplit generated by the InputFormat for the job.
But, the mapred.map.tasks definition is
>> The default number of map tasks per job. Ignored when mapred.job.tracker is "local".
So, is the number of map tasks spawned based on the number of InputSplits generated or based on the mapred.map.tasks value specified in the configuration file?
Thanks, Praveen
+
Praveen Sripati 2010-04-25, 10:58
-
Re: Number of map tasks spawned
Praveen Sripati 2010-04-27, 01:06
Could someone please answer this?
Thanks, Praveen
On Sun, Apr 25, 2010 at 4:28 PM, Praveen Sripati <[EMAIL PROTECTED]>wrote:
> > Hi, > > The MapReduce tutorial specifies that > > >> The Hadoop Map/Reduce framework spawns one map task for each InputSplit > generated by the InputFormat for the job. > > But, the mapred.map.tasks definition is > > >> The default number of map tasks per job. Ignored when mapred.job.tracker > is "local". > > So, is the number of map tasks spawned based on the number of InputSplits > generated or based on the mapred.map.tasks value specified in the > configuration file? > > Thanks, > Praveen > > -- Praveen
+
Praveen Sripati 2010-04-27, 01:06
-
Re: Number of map tasks spawned
Hemanth Yamijala 2010-04-27, 12:01
On Sun, Apr 25, 2010 at 4:28 PM, Praveen Sripati <[EMAIL PROTECTED]> wrote: > > Hi, > > The MapReduce tutorial specifies that > >>> The Hadoop Map/Reduce framework spawns one map task for each InputSplit >>> generated by the InputFormat for the job. > > But, the mapred.map.tasks definition is > >>> The default number of map tasks per job. Ignored when mapred.job.tracker >>> is "local". > > So, is the number of map tasks spawned based on the number of InputSplits > generated or based on the mapred.map.tasks value specified in the > configuration file?
The former.
+
Hemanth Yamijala 2010-04-27, 12:01
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext