Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: specify Mapred tasks and slots


Copy link to this message
-
Re: specify Mapred tasks and slots
Thanks Harsh and all friends response. That's helpful.

On Thu, Aug 8, 2013 at 11:55 AM, Harsh J <[EMAIL PROTECTED]> wrote:

> What Devaraj said. Except that if you use CapacityScheduler, then you
> can bind together memory requests and slot concepts, and be able to have a
> task
> grab more than one slot for itself when needed. We've discussed this
> aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
>
> On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <[EMAIL PROTECTED]> wrote:
> > One task can use only one slot, It cannot use more than one slot. If the
> > task is Map task then it will use one map slot and if the task is reduce
> > task the it will use one reduce slot from the configured ones.
> >
> >
> >
> > Thanks
> >
> > Devaraj k
> >
> >
> >
> > From: Azuryy Yu [mailto:[EMAIL PROTECTED]]
> > Sent: 08 August 2013 08:27
> > To: [EMAIL PROTECTED]
> > Subject: Re: specify Mapred tasks and slots
> >
> >
> >
> > My question is can I specify how many slots to be used for each M/R task?
> >
> >
> >
> > On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <[EMAIL PROTECTED]>
> > wrote:
> >
> > Slots are decided upon the configuration of machines, RAM etc...
> >
> >
> > Regards,
> >
> > Som Shekhar Sharma
> >
> > +91-8197243810
> >
> >
> >
> > On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <[EMAIL PROTECTED]> wrote:
> >
> > Hi Dears,
> >
> >
> >
> > Can I specify how many slots to use for reduce?
> >
> >
> >
> > I know we can specify reduces tasks, but is there one task occupy one
> slot?
> >
> >
> >
> > it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
> >
> >
> >
> > Thanks.
> >
> >
> >
> >
>
>
>
> --
> Harsh J
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB