Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> ResourceManager not getting started in 0.23


Copy link to this message
-
Re: ResourceManager not getting started in 0.23
Arun,

Thanks for the response.

I had to explicitly add the hadoop-common-0.23.1-SNAPSHOT.jar in the
classpath using the below commands.

cd $HADOOP_COMMON_HOME/share/hadoop/mapreduce/
ln -s ../common/hadoop-common-0.23.1-SNAPSHOT.jar

But, now ResourceManager fails silently with the following output in the
yarn-praveensripati-resourcemanager-praveen-laptop.out. When I run jps, I
don't see ResourceManager.

/usr/lib/jvm/jdk1.6.0_27/bin/java -Dproc_resourcemanager -Xmx1000m
-Dhadoop.log.dir=/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/logs
-Dyarn.logs.dir=/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/logs
-Dhadoop.log.file=yarn-praveensripati-resourcemanager-praveen-laptop.log
-Dyarn.log.file=yarn-praveensripati-resourcemanager-praveen-laptop.log
-Dyarn.home.dir= -Dyarn.id.str=praveensripati
-Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA
-Dyarn.policy.file=hadoop-policy.xml
-Dhadoop.log.dir=/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/logs
-Dyarn.log.dir=/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/logs
-Dhadoop.log.file=yarn-praveensripati-resourcemanager-praveen-laptop.log
-Dyarn.log.file=yarn-praveensripati-resourcemanager-praveen-laptop.log
-Dyarn.home.dir=/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT
-Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath
/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/conf:/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/conf:/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/conf:/usr/lib/jvm/jdk1.6.0_27/lib/tools.jar:/usr/lib/jvm/jdk1.6.0_27/lib/tools.jar:/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/share/hadoop/mapreduce/*:/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/share/hadoop/mapreduce/lib/*:/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/conf/rm-config/log4j.properties
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.yarn.server.resourcemanager.ResourceManager).
log4j:WARN Please initialize the log4j system properly.

Regards,
Praveen

On Wed, Dec 21, 2011 at 11:08 PM, Arun C Murthy <[EMAIL PROTECTED]> wrote:

> Two ways around:
>
> # You might have a stale version of hadoop-common, apparently that should
> fix it.
> # Upgrade to include MAPREDUCE-3588 which got committed yesterday.
>
> Arun
>
>
> On Dec 21, 2011, at 9:34 AM, Praveen Sripati wrote:
>
> > Hi,
> >
> > I am making some change to the 0.23 branch and got the latest code and
> > successfully build it. Am able to start the NameNode and the DataNode,
> but
> > when I start the ResourceManager I am getting 'ClassNotFoundException'.
> The
> > classpath to run the ResourceManager is not getting generated properly by
> > the 'sbin/yarn-daemon.sh' command. I also noticed that the modules folder
> > is not getting created when the hadoop-0.23.1-SNAPSHOT.tar.gz is
> untarred.
> >
> > Is this a bug or I missed something?
> >
> > ---------------------
> >
> > sbin/yarn-daemon.sh start resourcemanager
> >
> > -classpath
> >
> /home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/conf/:/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/conf/:/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/conf/:/usr/lib/jvm/jdk1.6.0_27/lib/tools.jar:/usr/lib/jvm/jdk1.6.0_27/lib/tools.jar:/home/praveensripati/Hadoop/0.23/deploy/hadoop-0.23.1-SNAPSHOT/conf//rm-config/log4j.properties
> >
> > Caused by: java.lang.ClassNotFoundException:
> > org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
> >    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >    at java.security.AccessController.doPrivileged(Native Method)
> >
> > ---------------------
> >
> > BTW, I am able to run the example Hadoop after downloading
> > hadoop-0.23.0.tar.gz from Apache.
> >
> > I have the following settings in .bashrc
> >
> > export
> >
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB