Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Changing default scheduler in hadoop


Copy link to this message
-
Re: Changing default scheduler in hadoop
Hi,

On Sun, Apr 13, 2014 at 10:47 AM, Mahesh Khandewal
<[EMAIL PROTECTED]> wrote:

Doing a simple 'find' in the source checkout for name pattern
'Scheduler' should reveal pretty relevant hits. We do name our Java
classes seriously :)

https://github.com/apache/hadoop-common/blob/release-1.1.2/src/mapred/org/apache/hadoop/mapred/JobQueueTaskScheduler.java
You can override the mapred-site.xml placed property
'mapred.jobtracker.taskScheduler' to specify a custom scheduler (or a
supplied one, such as Fair
[http://hadoop.apache.org/docs/r1.1.2/fair_scheduler.html] or Capacity
[http://hadoop.apache.org/docs/r1.1.2/capacity_scheduler.html]
Schedulers).
Remove the configuration override, and it will always go back to the
default FIFO based scheduler, the same whose source has been linked
above.
Are you unsure about this?

Harsh J

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB