Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Hadoop Yarn assembly error


Copy link to this message
-
Hadoop Yarn assembly error
Hi All

I have 3 quick questions to ask.

1.
I am following this single node tutorial
http://hadoop.apache.org/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/SingleCluster.html.
Unfortunately when I issue maven command "mvn clean install
assembly:assembly -Pnative" I get the following error.

[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] hadoop-mapreduce-client ........................... SUCCESS [1.268s]
[INFO] hadoop-mapreduce-client-core ...................... SUCCESS [25.009s]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [20.123s]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [1.501s]
[INFO] hadoop-mapreduce-client-app ....................... SUCCESS
[4:22.816s]
[INFO] hadoop-mapreduce-client-hs ........................ SUCCESS
[1:02.112s]
[INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS
[41:08.688s]
[INFO] hadoop-mapreduce-client-hs-plugins ................ SUCCESS [0.810s]
[INFO] Apache Hadoop MapReduce Examples .................. SUCCESS [10.049s]
[INFO] hadoop-mapreduce .................................. FAILURE [5.524s]
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 47:40.071s
[INFO] Finished at: Tue Jan 22 13:05:45 CET 2013
[INFO] Final Memory: 38M/168M
[INFO]
------------------------------------------------------------------------
[WARNING] The requested profile "native" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.3:assembly (default-cli)
on project hadoop-mapreduce: Error reading assemblies: No assembly
descriptors found. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]   mvn <goals> -rf :hadoop-mapreduce

I have updated Hadoop Yarn project to revision 1437204 and my svn
repository address is https://svn.apache.org/repos/asf/hadoop/common/trunk.
Can anyone guide me on how to build the "full" Yarn project (the Hadoop
Next Gen with MR).

2.
I got a little bit confused regarding numeration of the Hadoop versions.
Hadoop version 1.* is a continuation of the 0.20.203 (no Yarn
architecture), while 0.23.* is Next Gen Hadoop (Yarn based architecture),
also the alpha version 2.*. Is this reasoning correct? Also svn address
which I mentioned earlier downloads from trunk which Hadoop's version
(newest stable based on 0.23.* or newest 2.* alpha, or maybe some other)?

3.
I would like to create a new Application Master for the Yarn Hadoop. Am I
using the correct repository (I think so since I can view src for the MR
AM)?

Thank you for your help.

regards
marcin
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB