Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - data locality


Copy link to this message
-
Re: data locality
Eugene Kirpichov 2011-10-26, 09:22
Thanks!

2011/10/26 Steve Loughran <[EMAIL PROTECTED]>:
> On 26/10/11 05:22, Eugene Kirpichov wrote:
>>
>> But I guess it isn't always possible to achieve optimal scheduling, right?
>> What's done then; any account for network topology perhaps?
>
> I'd recommend this paper if you are curious, it explains the Fair Scheduler
>
> http://www.cs.berkeley.edu/~matei/papers/2010/eurosys_delay_scheduling.pdf
>
> You can plug in different schedulers with different policies if you want
>

--
Eugene Kirpichov
Principal Engineer, Mirantis Inc. http://www.mirantis.com/
Editor, http://fprog.ru/