Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Re: why FairScheduler prefer to schedule MR jobs into the same node?


Copy link to this message
-
Re: why FairScheduler prefer to schedule MR jobs into the same node?
Sandy Ryza 2013-08-08, 17:17
Hi devdoer,

What version are you using?

-Sandy
On Thu, Aug 8, 2013 at 4:25 AM, devdoer bird <[EMAIL PROTECTED]> wrote:

> HI:
>
> I configure the FairScheduler with default settings and my job has 19
>  reduce tasks. I found that all the reduce tasks are schedule to run in one
> node.
>
> While with default FIFO schedule, the 19 reduce tasks are scheduled into
> diffrent nodes.
>
> How can I configure FairSchedule to load more balance?
>
>
> --
> devdoer
> [EMAIL PROTECTED]
>
+
Karthik Kambatla 2013-08-09, 21:48
+
devdoer bird 2013-08-10, 06:39