Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Changing default scheduler in hadoop


Copy link to this message
-
Re: Changing default scheduler in hadoop
Hi,

On Sun, Apr 13, 2014 at 10:47 AM, Mahesh Khandewal
<[EMAIL PROTECTED]> wrote:

Doing a simple 'find' in the source checkout for name pattern
'Scheduler' should reveal pretty relevant hits. We do name our Java
classes seriously :)

https://github.com/apache/hadoop-common/blob/release-1.1.2/src/mapred/org/apache/hadoop/mapred/JobQueueTaskScheduler.java
You can override the mapred-site.xml placed property
'mapred.jobtracker.taskScheduler' to specify a custom scheduler (or a
supplied one, such as Fair
[http://hadoop.apache.org/docs/r1.1.2/fair_scheduler.html] or Capacity
[http://hadoop.apache.org/docs/r1.1.2/capacity_scheduler.html]
Schedulers).
Remove the configuration override, and it will always go back to the
default FIFO based scheduler, the same whose source has been linked
above.
Are you unsure about this?

Harsh J