Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste


Copy link to this message
-
Re: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste
Subroto 2012-07-11, 13:46
Hi Andre,

Yups the problem got solved.
The problem I was facing was that JobClient code of my application was messing the Hadoop Property:yarn.application.classpath.
After setting it to proper value now things work nice.
Current configuration looks something like this:
yarn.application.classpath=$HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/share/hadoop/common/*, $HADOOP_COMMON_HOME/share/hadoop/common/lib/*, $HADOOP_HDFS_HOME/share/hadoop/hdfs/*, $HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*, $YARN_HOME/share/hadoop/mapreduce/*, $YARN_HOME/share/hadoop/mapreduce/lib/*

Hope this works for you as well….

Cheers,
Subroto Sanyal

On Jul 11, 2012, at 3:14 PM, Andreas Reiter wrote:

> Hi Subroto,
>
> i have the same problem, can not get my mapreduce jobs to run...
> The container log sais, that org.apache.hadoop.mapreduce.v2.app.MRAppMaster  can not be found... :-(
>
> did you solve it already?
>
> best regards
> andre
>
>
>
>> ----- Original Message -----
>> From: Subroto <[EMAIL PROTECTED]>
>> Sent: Tue, 5 Jun 2012 14:00:25 +0200
>> To: [EMAIL PROTECTED]
>> CC:
>> Subject: Re: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste
>
>> Hi,
>>
>> Is it expected to set the /yarn application.classpath/ to:
>> /usr/local/hadoop/etc/hadoop,/usr/local/hadoop/share/hadoop/mapreduce/*,/usr/local/hadoop/share/hadoop/mapreduce/lib/*,/usr/local/hadoop/share/hadoop/common/*,/usr/local/hadoop/share/hadoop/common/lib/*,/usr/local/hadoop/share/hadoop/hdfs/*,/usr/local/hadoop/share/hadoop/hdfs/lib*
>>
>> I am trying to run the application not from the cluster. Are there any specific settings needs to be done in Cluster so that I can go ahead with default /yarn application.classpath?/
>>
>> Regards,
>> Subroto Sanyal
>> On Jun 5, 2012, at 12:25 PM, Subroto wrote:
>>
>>> Hi Deva,
>>>
>>> Tried the yarn application path with absolute values. Still it didn't work.  It failed with same stack trace:-(
>>> Now the value of yarn.application.classpath was:
>>> /usr/local/hadoop/etc/hadoop,/usr/local/hadoop/*,/usr/local/hadoop/lib/*,/usr/local/hadoop/*,/usr/local/hadoop/lib/*,/usr/local/hadoop/*,/usr/local/hadoop/lib/*,/usr/local/hadoop/*,/usr/local/hadoop/*
>>>
>>> Cheers,
>>> Subroto Sanyal
>>> On Jun 5, 2012, at 12:07 PM, Devaraj k wrote:
>>>
>>>> Hi Subroto,
>>>>
>>>>    It will not use yarn-env.sh for launching the application master. NM uses the environment set by the client for launching application master.  Can you set the environment variables in /etc/profile or update the yarn application classpath with the absolute paths.
>>>>
>>>> Thanks
>>>> Devaraj
>>>> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>>>> *From:*Subroto [[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>]
>>>> *Sent:*Tuesday, June 05, 2012 2:25 PM
>>>> *To:*[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
>>>> *Subject:*Re: java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaste
>>>>
>>>> Hi Deva,
>>>>
>>>> Thanks for your response.
>>>> The file etc/hadoop/yarn-env.sh has the following entries: