Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> a question


Hi,
I have a jar file from a hadoop scheduler(AdaptiveScheduler=resource aware slotless adaptive scheduler).I'm sure that this jar file works properly.I set the required properties in mapred-site.xml correctly, and I put the adaptivescheduler.jar file in the library of hadoop.but when I start my cluster,(using this command: bin/start-all.sh),jobtracker doesn't run.the error is:
 
2013-07-17 06:07:18,631 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG:   host = master/192.168.0.112
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.20.203.0
STARTUP_MSG:   build = http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203 -r 1099333; compiled by 'oom' on Wed May  4 07:57:50 PDT 2011
************************************************************/
2013-07-17 06:07:19,349 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2013-07-17 06:07:19,361 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
2013-07-17 06:07:19,362 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2013-07-17 06:07:19,362 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: JobTracker metrics system started
2013-07-17 06:07:20,585 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered.
2013-07-17 06:07:20,588 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists!
2013-07-17 06:07:20,590 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2013-07-17 06:07:20,632 INFO org.apache.hadoop.mapred.JobTracker: Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2013-07-17 06:07:20,633 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list
2013-07-17 06:07:20,665 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2013-07-17 06:07:20,665 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2013-07-17 06:07:20,997 INFO org.apache.hadoop.mapred.JobTracker: Starting jobtracker with owner as maedeh
2013-07-17 06:07:21,050 FATAL org.apache.hadoop.mapred.JobTracker: java.lang.RuntimeException: java.lang.RuntimeException: class org.apache.hadoop.mapred.AdaptiveScheduler not org.apache.hadoop.mapred.TaskScheduler
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:898)
    at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2276)
    at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2171)
    at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
    at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
    at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4956)
Caused by: java.lang.RuntimeException: class org.apache.hadoop.mapred.AdaptiveScheduler not org.apache.hadoop.mapred.TaskScheduler
    at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:892)
    ... 5 more

2013-07-17 06:07:21,134 INFO org.apache.hadoop.mapred.JobTracker: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down JobTracker at master/192.168.0.112
************************************************************/
 
how I can resolve this problem?please help me... my jar file is in this address:  /home/maedeh/hadoop-0.20.203.0/lib/adaptivescheduler.jar