Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - data locality


Copy link to this message
-
Re: data locality
Steve Loughran 2011-10-26, 09:14
On 26/10/11 05:22, Eugene Kirpichov wrote:
> But I guess it isn't always possible to achieve optimal scheduling, right?
> What's done then; any account for network topology perhaps?

I'd recommend this paper if you are curious, it explains the Fair Scheduler

http://www.cs.berkeley.edu/~matei/papers/2010/eurosys_delay_scheduling.pdf

You can plug in different schedulers with different policies if you want