Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> Building and Deploying MRv2


Copy link to this message
-
Re: Building and Deploying MRv2

Hi,

The hdfs build was successful after including the -Dforrest.home
property to the ant command.

***********

When  I started the mapreduce build to get the below error.

mvn clean install assembly:assembly

Downloaded:
http://repo1.maven.org/maven2/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.jar
(49 KB at 24.4 KB/sec)
yarn_protos.proto:4:8: Option "java_generate_equals_and_hash" unknown.
[INFO]

[INFO]
------------------------------------------------------------------------
[INFO] Skipping hadoop-mapreduce
[INFO] This project has been banned from the build due to previous failures.
[INFO]
------------------------------------------------------------------------
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] yarn-api .......................................... FAILURE
[13:23.081s]
[INFO] yarn-common ....................................... SKIPPED
[INFO] yarn-server-common ................................ SKIPPED
[INFO] yarn-server-nodemanager ........................... SKIPPED
[INFO] yarn-server-resourcemanager ....................... SKIPPED
[INFO] yarn-server-tests ................................. SKIPPED
[INFO] yarn-server ....................................... SKIPPED
[INFO] yarn .............................................. SKIPPED
[INFO] hadoop-mapreduce-client-core ...................... SKIPPED
[INFO] hadoop-mapreduce-client-common .................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
[INFO] hadoop-mapreduce-client-app ....................... SKIPPED
[INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
[INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
[INFO] hadoop-mapreduce-client ........................... SKIPPED
[INFO] hadoop-mapreduce .................................. SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 13:45.437s
[INFO] Finished at: Thu Jun 16 18:30:48 IST 2011
[INFO] Final Memory: 6M/15M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.codehaus.mojo:exec-maven-plugin:1.2:exec (generate-sources) on
project yarn-api: Command execution failed. Process exited with an
error: 1(Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

***********

I started building the commons and had to include -Djava5.home and
-Dforrest.home properties in the ant command.

ant -Djava5.home=/usr/lib/jvm/java-6-openjdk
-Dforrest.home=/home/praveensripati/Installations/apache-forrest-0.9
veryclean mvn-install tar

And then I get the below error and the build hangs , but I see 4 jars in
the build folder including hadoop-common-0.22.0-SNAPSHOT.jar.

      [exec] Cocoon will report the status of each document:
      [exec]   - in column 1: *=okay X=brokenLink ^=pageSkipped (see FAQ).
      [exec]
      [exec]
------------------------------------------------------------------------
      [exec] cocoon 2.1.12-dev
      [exec] Copyright (c) 1999-2007 Apache Software Foundation. All
rights reserved.
      [exec]
------------------------------------------------------------------------
      [exec]
      [exec]
      [exec] * [1/29]    [29/29]   6.547s 9.4Kb   linkmap.html
      [exec] * [2/29]    [1/28]    1.851s 22.3Kb  hdfs_shell.html
      [exec] * [4/28]    [1/28]    1.156s 21.1Kb  distcp.html
      [exec] * [5/27]    [0/0]     0.306s 0b      distcp.pdf
      [exec] Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/fop/messaging/MessageHandler
      [exec] at
org.apache.cocoon.serialization.FOPSerializer.configure(FOPSerializer.java:122)


I included the following in the common/ivy.xml and the
./common/build/ivy/lib/Hadoop-Common/common/fop-0.93.jar file is there.

     <dependency org="org.apache.xmlgraphics"
       name="fop"
       rev="${fop.version}"
       conf="common->default"/>

and the following in the common/ivy/libraries.properties and still get
the same error.

fop.version=0.93

Thanks,
Praveen

On Thursday 16 June 2011 07:55 AM, Luke Lu wrote:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB