Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> DefaultResourceCalculator class not found, ResourceManager fails to start.


+
Rob Blah 2013-08-11, 10:27
+
Rob Blah 2013-08-11, 21:07
Copy link to this message
-
Re: DefaultResourceCalculator class not found, ResourceManager fails to start.
Can you check the config entry
for yarn.scheduler.capacity.resource-calculator ?
It should point
to org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator

bq. I was able to fix all issues

What other issues came up ?

Thanks

On Sun, Aug 11, 2013 at 2:07 PM, Rob Blah <[EMAIL PROTECTED]> wrote:

> Hi again
>
> From a little investigation I have performed I have observed the
> following. I assume the module responsible for this class is
> hadoop-yarn-common.
>
> During RM init it crashes since it is looking for a class
> DefaultResourceCalculator in
> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator,
> while the class is present in hadoop-yarn-common-3.0.0-SNAPSHOT.jar but
> under org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator. Thus
> the RM crashes. Anybody knows how I can fix this? I would very grateful for
> any help.
>
> regards
> tmp
>
>
> 2013/8/11 Rob Blah <[EMAIL PROTECTED]>
>
>> Hi
>>
>> I have a strange problem, regarding missing class, the
>> DefaultResourceCalculator. I have a single node sandbox cluster working in
>> a pseudo-distributed mode. The cluster was working fine yesterday, however
>> today it stopped working. I was able to fix all issues except the following
>> problem in ResourceManager:
>> 2013-08-11 12:12:42,425 FATAL
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error
>> starting ResourceManager
>> java.lang.RuntimeException: java.lang.RuntimeException:
>> java.lang.ClassNotFoundException: Class
>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>> not found
>>     at
>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1753)
>>     at
>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacitySchedulerConfiguration.getResourceCalculator(CapacitySchedulerConfiguration.java:333)
>>     at
>> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:258)
>>     at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:241)
>>     at
>> org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>>     at
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:826)
>> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
>> Class
>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>> not found
>>     at
>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1721)
>>     at
>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1745)
>>     ... 5 more
>> Caused by: java.lang.ClassNotFoundException: Class
>> org.apache.hadoop.yarn.server.resourcemanager.resource.DefaultResourceCalculator
>> not found
>>     at
>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1625)
>>     at
>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1719)
>>     ... 6 more
>> 2013-08-11 12:12:42,426 INFO
>> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager:
>> SHUTDOWN_MSG:
>>
>> I build YARN from sources, daily updated to the newest revision in trunk.
>> The class DefaultResourceCalculator exists and is present in YARN's
>> sources. I am using (currently) trunk revision 1512895. I build YARN
>> project with the following command:
>> mvn clean package -Pdist -Dtar -DskipTests
>> I create tar ball with the use of script provided in the sources:
>> dist-tar-stitching.sh (hadoop-dist/target)
>>
>> regards
>> tmp
>>
>
>
+
Rob Blah 2013-08-12, 08:46
+
Rob Blah 2013-11-15, 13:14