Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> a question


Copy link to this message
-
Re: a question
Adding back [EMAIL PROTECTED]

Which hadoop version did you use ?

Did you build the jar file against the same hadoop version ?

One possibility was that AdaptiveScheduler from
MAPREDUCE-1380<https://issues.apache.org/jira/browse/MAPREDUCE-1380>doesn't
match the signature of TaskScheduler
in the hadoop release you used.

Cheers

On Sat, Jul 20, 2013 at 7:09 AM, Hamedreza Berenjian <
[EMAIL PROTECTED]> wrote:

> Hi,
> Yes,exactly. The same scheduler which is in this address:
> https://issues.apache.org/jira/browse/MAPREDUCE-1380
> I attached the jar file. how I can resolve this problem?please help me...
>
>    *From:* Ted Yu <[EMAIL PROTECTED]>
> *To:* [EMAIL PROTECTED]; Hamedreza Berenjian <
> [EMAIL PROTECTED]>
> *Sent:* Saturday, 20 July 2013, 6:52:16
> *Subject:* Re: a question
>
> Did the AdaptiveScheduler come from MAPREDUCE-1380 ?
>
> Thanks
>
> On Fri, Jul 19, 2013 at 11:23 PM, Hamedreza Berenjian <
> [EMAIL PROTECTED]> wrote:
>
> Hi,
> I have a jar file from a hadoop scheduler(AdaptiveScheduler=resource aware
> slotless adaptive scheduler).I'm sure that this jar file works properly.I
> set the required properties in mapred-site.xml correctly, and I put the
> adaptivescheduler.jar file in the library of hadoop.but when I start my
> cluster,(using this command: bin/start-all.sh),jobtracker doesn't run.the
> error is:
>
> 2013-07-17 06:07:18,631 INFO org.apache.hadoop.mapred.JobTracker:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting JobTracker
> STARTUP_MSG:   host = master/192.168.0.112
> STARTUP_MSG:   args = []
> STARTUP_MSG:   version = 0.20.203.0
> STARTUP_MSG:   build > http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-203-r 1099333; compiled by 'oom' on Wed May  4 07:57:50 PDT 2011
> ************************************************************/
> 2013-07-17 06:07:19,349 INFO
> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
> hadoop-metrics2.properties
> 2013-07-17 06:07:19,361 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2013-07-17 06:07:19,362 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2013-07-17 06:07:19,362 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: JobTracker metrics
> system started
> 2013-07-17 06:07:20,585 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2013-07-17 06:07:20,588 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2013-07-17 06:07:20,590 INFO
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
> Updating the current master key for generating delegation tokens
> 2013-07-17 06:07:20,632 INFO org.apache.hadoop.mapred.JobTracker:
> Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
> limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
> 2013-07-17 06:07:20,633 INFO org.apache.hadoop.util.HostsFileReader:
> Refreshing hosts (include/exclude) list
> 2013-07-17 06:07:20,665 INFO
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
> Starting expired delegation token remover thread,
> tokenRemoverScanInterval=60 min(s)
> 2013-07-17 06:07:20,665 INFO
> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
> Updating the current master key for generating delegation tokens
> 2013-07-17 06:07:20,997 INFO org.apache.hadoop.mapred.JobTracker: Starting
> jobtracker with owner as maedeh
> 2013-07-17 06:07:21,050 FATAL org.apache.hadoop.mapred.JobTracker:
> java.lang.RuntimeException: java.lang.RuntimeException: class
> org.apache.hadoop.mapred.AdaptiveScheduler not
> org.apache.hadoop.mapred.TaskScheduler
>     at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:898)