Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # dev >> a question


+
Hamedreza Berenjian 2013-07-20, 06:23
+
Shekhar Sharma 2013-07-20, 13:33
Copy link to this message
-
Re: a question
Did the AdaptiveScheduler come from MAPREDUCE-1380 ?

Thanks

On Fri, Jul 19, 2013 at 11:23 PM, Hamedreza Berenjian <
[EMAIL PROTECTED]> wrote:

> Hi,
> I have a jar file from a hadoop scheduler(AdaptiveScheduler=resource aware
> slotless adaptive scheduler).I'm sure that this jar file works properly.I
> set the required properties in mapred-site.xml correctly, and I put the
> adaptivescheduler.jar file in the library of hadoop.but when I start my
> cluster,(using this command: bin/start-all.sh),jobtracker doesn't run.the
> error is:
>
> 2013-07-17 06:07:18,631 INFO org.apache.hadoop.mapred.JobTracker:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting JobTracker
> STARTUP_MSG:   host = master/192.168.0.112
> STARTUP_MSG:   args = []
> STARTUP_MSG:   version = 0.20.203.0
> STARTUP_MSG:   build > http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203-r 1099333; compiled by 'oom' on Wed May  4 07:57:50 PDT 2011
> ************************************************************/
> 2013-07-17 06:07:19,349 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2013-07-17 06:07:19,361 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2013-07-17 06:07:19,362 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2013-07-17 06:07:19,362 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: JobTracker metrics
> system started
> 2013-07-17 06:07:20,585 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2013-07-17 06:07:20,588 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2013-07-17 06:07:20,590 INFO
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
> Updating the current master key for generating delegation tokens
> 2013-07-17 06:07:20,632 INFO org.apache.hadoop.mapred.JobTracker:
> Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
> limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
> 2013-07-17 06:07:20,633 INFO org.apache.hadoop.util.HostsFileReader:
> Refreshing hosts (include/exclude) list
> 2013-07-17 06:07:20,665 INFO
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
> Starting expired delegation token remover thread,
> tokenRemoverScanInterval=60 min(s)
> 2013-07-17 06:07:20,665 INFO
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
> Updating the current master key for generating delegation tokens
> 2013-07-17 06:07:20,997 INFO org.apache.hadoop.mapred.JobTracker: Starting
> jobtracker with owner as maedeh
> 2013-07-17 06:07:21,050 FATAL org.apache.hadoop.mapred.JobTracker:
> java.lang.RuntimeException: java.lang.RuntimeException: class
> org.apache.hadoop.mapred.AdaptiveScheduler not
> org.apache.hadoop.mapred.TaskScheduler
>     at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:898)
>     at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2276)
>     at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2171)
>     at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300)
>     at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291)
>     at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4956)
> Caused by: java.lang.RuntimeException: class
> org.apache.hadoop.mapred.AdaptiveScheduler not
> org.apache.hadoop.mapred.TaskScheduler
>     at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:892)
>     ... 5 more
>
> 2013-07-17 06:07:21,134 INFO org.apache.hadoop.mapred.JobTracker:
> SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down JobTracker at master/192.168.0.112
> ************************************************************/
+
Ted Yu 2013-07-20, 14:17
+
Hamedreza Berenjian 2013-07-25, 15:17