Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Fair Scheduler pools regardless of users

Copy link to this message
Fair Scheduler pools regardless of users
Amit Sela 2013-07-08, 10:53
Hi all,

I was wondering if there is a way to let fair scheduler ignore the user and
submit a job to a specific pool.
I would like to have 3/4 pools:

1. Very short (~1 min) routine jobs.
2. Normal processing time (<1 hr) routine jobs.
3. Long (days) experimental jobs.
4. ? ad hoc immediate jobs ?

Users matter less in my use case.



(Running 20 nodes cluster with Hadoop 1.0.4)