Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> data locality

Copy link to this message
Re: data locality

2011/10/26 Steve Loughran <[EMAIL PROTECTED]>:
> On 26/10/11 05:22, Eugene Kirpichov wrote:
>> But I guess it isn't always possible to achieve optimal scheduling, right?
>> What's done then; any account for network topology perhaps?
> I'd recommend this paper if you are curious, it explains the Fair Scheduler
> http://www.cs.berkeley.edu/~matei/papers/2010/eurosys_delay_scheduling.pdf
> You can plug in different schedulers with different policies if you want

Eugene Kirpichov
Principal Engineer, Mirantis Inc. http://www.mirantis.com/
Editor, http://fprog.ru/