Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> hybrid map/reducer scheduler?

Copy link to this message
Re: hybrid map/reducer scheduler?

> In addition to default FIFO scheduler, there are fair scheduler and capacity scheduler. In some sense, fair scheduler can be considered a user-based scheduling while capacity scheduler does a queue-based scheduling. Is there or will there be a hybrid scheduler that combines the good parts of the two (or a capacity scheduler that allows preemption, then different users are asked to submit jobs to different queues, in this way implicitly follow user-based scheduling as well, more or less)?

What user specific features are looking on top of capacity scheduler ?
Please note that the capacity scheduler already supports some user
specific concepts like limits per user per queue.