Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Hadoop Yarn assembly error


Copy link to this message
-
Hadoop Yarn assembly error
Hi All

I have 3 quick questions to ask.

1.
I am following this single node tutorial
http://hadoop.apache.org/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/SingleCluster.html.
Unfortunately when I issue maven command "mvn clean install
assembly:assembly -Pnative" I get the following error.

[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] hadoop-mapreduce-client ........................... SUCCESS [1.268s]
[INFO] hadoop-mapreduce-client-core ...................... SUCCESS [25.009s]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [20.123s]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [1.501s]
[INFO] hadoop-mapreduce-client-app ....................... SUCCESS
[4:22.816s]
[INFO] hadoop-mapreduce-client-hs ........................ SUCCESS
[1:02.112s]
[INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS
[41:08.688s]
[INFO] hadoop-mapreduce-client-hs-plugins ................ SUCCESS [0.810s]
[INFO] Apache Hadoop MapReduce Examples .................. SUCCESS [10.049s]
[INFO] hadoop-mapreduce .................................. FAILURE [5.524s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 47:40.071s
[INFO] Finished at: Tue Jan 22 13:05:45 CET 2013
[INFO] Final Memory: 38M/168M
[INFO]
------------------------------------------------------------------------
[WARNING] The requested profile "native" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.3:assembly (default-cli)
on project hadoop-mapreduce: Error reading assemblies: No assembly
descriptors found. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]   mvn <goals> -rf :hadoop-mapreduce

I have updated Hadoop Yarn project to revision 1437204 and my svn
repository address is https://svn.apache.org/repos/asf/hadoop/common/trunk.
Can anyone guide me on how to build the "full" Yarn project (the Hadoop
Next Gen with MR).

2.
I got a little bit confused regarding numeration of the Hadoop versions.
Hadoop version 1.* is a continuation of the 0.20.203 (no Yarn
architecture), while 0.23.* is Next Gen Hadoop (Yarn based architecture),
also the alpha version 2.*. Is this reasoning correct? Also svn address
which I mentioned earlier downloads from trunk which Hadoop's version
(newest stable based on 0.23.* or newest 2.* alpha, or maybe some other)?

3.
I would like to create a new Application Master for the Yarn Hadoop. Am I
using the correct repository (I think so since I can view src for the MR
AM)?

Thank you for your help.

regards
marcin