Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # dev - Building and Deploying MRv2


Copy link to this message
-
Re: Building and Deploying MRv2
Praveen Sripati 2011-06-16, 13:10

Hi,

The hdfs build was successful after including the -Dforrest.home
property to the ant command.

***********

When  I started the mapreduce build to get the below error.

mvn clean install assembly:assembly

Downloaded:
http://repo1.maven.org/maven2/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.jar
(49 KB at 24.4 KB/sec)
yarn_protos.proto:4:8: Option "java_generate_equals_and_hash" unknown.
[INFO]

[INFO]
------------------------------------------------------------------------
[INFO] Skipping hadoop-mapreduce
[INFO] This project has been banned from the build due to previous failures.
[INFO]
------------------------------------------------------------------------
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] yarn-api .......................................... FAILURE
[13:23.081s]
[INFO] yarn-common ....................................... SKIPPED
[INFO] yarn-server-common ................................ SKIPPED
[INFO] yarn-server-nodemanager ........................... SKIPPED
[INFO] yarn-server-resourcemanager ....................... SKIPPED
[INFO] yarn-server-tests ................................. SKIPPED
[INFO] yarn-server ....................................... SKIPPED
[INFO] yarn .............................................. SKIPPED
[INFO] hadoop-mapreduce-client-core ...................... SKIPPED
[INFO] hadoop-mapreduce-client-common .................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
[INFO] hadoop-mapreduce-client-app ....................... SKIPPED
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client ........................... SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 13:45.437s
[INFO] Finished at: Thu Jun 16 18:30:48 IST 2011
[INFO] Final Memory: 6M/15M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.codehaus.mojo:exec-maven-plugin:1.2:exec (generate-sources) on
project yarn-api: Command execution failed. Process exited with an
error: 1(Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

***********

I started building the commons and had to include -Djava5.home and
-Dforrest.home properties in the ant command.

ant -Djava5.home=/usr/lib/jvm/java-6-openjdk
-Dforrest.home=/home/praveensripati/Installations/apache-forrest-0.9
veryclean mvn-install tar

And then I get the below error and the build hangs , but I see 4 jars in
the build folder including hadoop-common-0.22.0-SNAPSHOT.jar.

      [exec] Cocoon will report the status of each document:
      [exec]   - in column 1: *=okay X=brokenLink ^=pageSkipped (see FAQ).
      [exec]
      [exec]
------------------------------------------------------------------------
      [exec] cocoon 2.1.12-dev
      [exec] Copyright (c) 1999-2007 Apache Software Foundation. All
rights reserved.
      [exec]
------------------------------------------------------------------------
      [exec]
      [exec]
      [exec] * [1/29]    [29/29]   6.547s 9.4Kb   linkmap.html
      [exec] * [2/29]    [1/28]    1.851s 22.3Kb  hdfs_shell.html
      [exec] * [4/28]    [1/28]    1.156s 21.1Kb  distcp.html
      [exec] * [5/27]    [0/0]     0.306s 0b      distcp.pdf
      [exec] Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/fop/messaging/MessageHandler
      [exec] at
org.apache.cocoon.serialization.FOPSerializer.configure(FOPSerializer.java:122)


I included the following in the common/ivy.xml and the
./common/build/ivy/lib/Hadoop-Common/common/fop-0.93.jar file is there.

     <dependency org="org.apache.xmlgraphics"
       name="fop"
       rev="${fop.version}"
       conf="common->default"/>

and the following in the common/ivy/libraries.properties and still get
the same error.

fop.version=0.93

Thanks,
Praveen

On Thursday 16 June 2011 07:55 AM, Luke Lu wrote: