Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Parallel mapred jobs in Yarn


Copy link to this message
-
Re: Parallel mapred jobs in Yarn
FairScheduler isn't ported yet to YARN. The default scheduler is there (
which is FifoScheduler) and CapacityScheduler can be configured too.

HTH,
+Vinod
On Wed, Nov 9, 2011 at 10:14 AM, Bharath Ravi <[EMAIL PROTECTED]>wrote:

> Thanks, Prashant!
> I'll try Yarn out with the Fairscheduler.
>
> On 8 November 2011 01:01, Prashant Sharma <[EMAIL PROTECTED]>
> wrote:
>
> > Yes! , you can do the same in yarn as well.
> > -P
> >
> > On Tue, Nov 8, 2011 at 3:24 AM, Bharath Ravi <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Hi all,
> > >
> > > I have a beginner's question:
> > > How can I configure yarn to allow multiple parallel mapreduce jobs to
> > run?
> > > Currently, the execution is sequential: each submitted job waits for
> the
> > > previous to run.
> > >
> > > In MR1, this could be done by enabling the
> > fairscheduler/capacityscheduler.
> > > Is there a similar configuration in Yarn as well?
> > >
> > > Thanks a lot!
> > > --
> > > Bharath Ravi
> > >
> >
>
>
>
> --
> Bharath Ravi
>