Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste


Copy link to this message
-
Re: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste
Hi Andre,

Yups the problem got solved.
The problem I was facing was that JobClient code of my application was messing the Hadoop Property:yarn.application.classpath.
After setting it to proper value now things work nice.
Current configuration looks something like this:
yarn.application.classpath=$HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/share/hadoop/common/*, $HADOOP_COMMON_HOME/share/hadoop/common/lib/*, $HADOOP_HDFS_HOME/share/hadoop/hdfs/*, $HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*, $YARN_HOME/share/hadoop/mapreduce/*, $YARN_HOME/share/hadoop/mapreduce/lib/*

Hope this works for you as well….

Cheers,
Subroto Sanyal

On Jul 11, 2012, at 3:14 PM, Andreas Reiter wrote:

> Hi Subroto,
>
> i have the same problem, can not get my mapreduce jobs to run...
> The container log sais, that org.apache.hadoop.mapreduce.v2.app.MRAppMaster  can not be found... :-(
>
> did you solve it already?
>
> best regards
> andre
>
>
>
>> ----- Original Message -----
>> From: Subroto <[EMAIL PROTECTED]>
>> Sent: Tue, 5 Jun 2012 14:00:25 +0200
>> To: [EMAIL PROTECTED]
>> CC:
>> Subject: Re: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste
>
>> Hi,
>>
>> Is it expected to set the /yarn application.classpath/ to:
>> /usr/local/hadoop/etc/hadoop,/usr/local/hadoop/share/hadoop/mapreduce/*,/usr/local/hadoop/share/hadoop/mapreduce/lib/*,/usr/local/hadoop/share/hadoop/common/*,/usr/local/hadoop/share/hadoop/common/lib/*,/usr/local/hadoop/share/hadoop/hdfs/*,/usr/local/hadoop/share/hadoop/hdfs/lib*
>>
>> I am trying to run the application not from the cluster. Are there any specific settings needs to be done in Cluster so that I can go ahead with default /yarn application.classpath?/
>>
>> Regards,
>> Subroto Sanyal
>> On Jun 5, 2012, at 12:25 PM, Subroto wrote:
>>
>>> Hi Deva,
>>>
>>> Tried the yarn application path with absolute values. Still it didn't work.  It failed with same stack trace:-(
>>> Now the value of yarn.application.classpath was:
>>> /usr/local/hadoop/etc/hadoop,/usr/local/hadoop/*,/usr/local/hadoop/lib/*,/usr/local/hadoop/*,/usr/local/hadoop/lib/*,/usr/local/hadoop/*,/usr/local/hadoop/lib/*,/usr/local/hadoop/*,/usr/local/hadoop/*
>>>
>>> Cheers,
>>> Subroto Sanyal
>>> On Jun 5, 2012, at 12:07 PM, Devaraj k wrote:
>>>
>>>> Hi Subroto,
>>>>
>>>>    It will not use yarn-env.sh for launching the application master. NM uses the environment set by the client for launching application master.  Can you set the environment variables in /etc/profile or update the yarn application classpath with the absolute paths.
>>>>
>>>> Thanks
>>>> Devaraj
>>>> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>>>> *From:*Subroto [[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>]
>>>> *Sent:*Tuesday, June 05, 2012 2:25 PM
>>>> *To:*[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
>>>> *Subject:*Re: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste
>>>>
>>>> Hi Deva,
>>>>
>>>> Thanks for your response.
>>>> The file etc/hadoop/yarn-env.sh has the following entries:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB