Bejoy Ks 2012-03-22, 15:01
The number of map tasks is determined by your number of input splits
and the Input Format used by your MR job. Setting this value won't help you
control the same. AFAIK it would get effective if the value in
mapred.map.tasks is greater than the no of tasks calculated by the Job
based on the splits and Input Format.
On Thu, Mar 22, 2012 at 8:28 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:
> Sorry I meant *setNumMapTasks. *What is mapred.map.tasks for? It's
> confusing as to what it's purpose is for? I tried setting it for my job
> still I see more map tasks running than *mapred.map.tasks*
> On Thu, Mar 22, 2012 at 7:53 AM, Harsh J <[EMAIL PROTECTED]> wrote:
> > There isn't such an API as "setNumTasks". There is however,
> > "setNumReduceTasks", which sets "mapred.reduce.tasks".
> > Does this answer your question?
> > On Thu, Mar 22, 2012 at 8:21 PM, Mohit Anchlia <[EMAIL PROTECTED]>
> > wrote:
> > > Could someone please help me answer this question?
> > >
> > > On Wed, Mar 14, 2012 at 8:06 AM, Mohit Anchlia <[EMAIL PROTECTED]
> > >wrote:
> > >
> > >> What is the corresponding system property for setNumTasks? Can it be
> > used
> > >> explicitly as system property like "mapred.tasks."?
> > --
> > Harsh J