|
|
-
Hadoop Yarn assembly errorblah blah 2013-01-22, 22:13
Hi All
I have 3 quick questions to ask. 1. I am following this single node tutorial http://hadoop.apache.org/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/SingleCluster.html. Unfortunately when I issue maven command "mvn clean install assembly:assembly -Pnative" I get the following error. [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] hadoop-mapreduce-client ........................... SUCCESS [1.268s] [INFO] hadoop-mapreduce-client-core ...................... SUCCESS [25.009s] [INFO] hadoop-mapreduce-client-common .................... SUCCESS [20.123s] [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [1.501s] [INFO] hadoop-mapreduce-client-app ....................... SUCCESS [4:22.816s] [INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [1:02.112s] [INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [41:08.688s] [INFO] hadoop-mapreduce-client-hs-plugins ................ SUCCESS [0.810s] [INFO] Apache Hadoop MapReduce Examples .................. SUCCESS [10.049s] [INFO] hadoop-mapreduce .................................. FAILURE [5.524s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 47:40.071s [INFO] Finished at: Tue Jan 22 13:05:45 CET 2013 [INFO] Final Memory: 38M/168M [INFO] ------------------------------------------------------------------------ [WARNING] The requested profile "native" could not be activated because it does not exist. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.3:assembly (default-cli) on project hadoop-mapreduce: Error reading assemblies: No assembly descriptors found. -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-mapreduce I have updated Hadoop Yarn project to revision 1437204 and my svn repository address is https://svn.apache.org/repos/asf/hadoop/common/trunk. Can anyone guide me on how to build the "full" Yarn project (the Hadoop Next Gen with MR). 2. I got a little bit confused regarding numeration of the Hadoop versions. Hadoop version 1.* is a continuation of the 0.20.203 (no Yarn architecture), while 0.23.* is Next Gen Hadoop (Yarn based architecture), also the alpha version 2.*. Is this reasoning correct? Also svn address which I mentioned earlier downloads from trunk which Hadoop's version (newest stable based on 0.23.* or newest 2.* alpha, or maybe some other)? 3. I would like to create a new Application Master for the Yarn Hadoop. Am I using the correct repository (I think so since I can view src for the MR AM)? Thank you for your help. regards marcin |