|
|
-
Re: Getting Giraph to build/run with CDH4 (cannot initialize cluster - check mapreduce.framework.name)Arun C Murthy 2013-02-26, 00:18
Pls ask CDH lists.
On Feb 25, 2013, at 8:26 AM, David Boyd wrote: > All: > I am trying to get the Giraph 0.2 snapshot (pulled via GIT on Friday) > to build and run with CDH4. > > I modified the pom.xml to provide a profile for my specific version (4.1.1). > The build works (mvn -Phadoop_cdh4.1.1 clean package test) and passes > all the tests. > > If I try to do the next step and submit to my cluster with the command: > mvn -Phadoop_cdh4.1.1 test -Dprop.mapred.job.tracker=10.1.94.53:8021 -Dgiraph.zkList=10.1.94.104:2181 > > the JSON test in core fails. If I move that test out of the way a whole bunch of tests in examples > fail. They all fail with: >> java.io.IOException: Cannot initialize Cluster. Please check your >> configuration for mapreduce.framework.name and the correspond server >> addresses. > > I have tried passing mapreduce.framework.name as both local and classic. I have also set those values in my mapreduce-site.xml. > > Interestingly I can run the pagerank benchmark in code with the command: >> hadoop jar >> ./giraph-core/target/giraph-0.2-SNAPSHOT-for-hadoop-2.0.0-cdh4.1.3-jar-with-dependencies.jar >> org.apache.giraph.benchmark.PageRankBenchmark >> -Dmapred.child.java-opts="-Xmx64g -Xms64g XX:+UseConcMarkSweepGC >> -XX:-UseGCOverheadLimit" -Dgiraph.zkList=10.1.94.104:2181 -e 1 -s 3 -v >> -V 50000 -w 83 > And it completes just fine. > > I have searched high and low for documents and examples on how to run the example programs from other > than maven but have not found any thing. > > Any help or suggestions would be greatly appreciated. > > THanks. > > > > -- > ========= mailto:[EMAIL PROTECTED] ===========> David W. Boyd > Director, Engineering, Research and Development > Data Tactics Corporation > 7901 Jones Branch, Suite 240 > Mclean, VA 22102 > office: +1-703-506-3735, ext 308 > fax: +1-703-506-6703 > cell: +1-703-402-7908 > ============== http://www.data-tactics.com/ ===========> > The information contained in this message may be privileged > and/or confidential and protected from disclosure. > If the reader of this message is not the intended recipient > or an employee or agent responsible for delivering this message > to the intended recipient, you are hereby notified that any > dissemination, distribution or copying of this communication > is strictly prohibited. If you have received this communication > in error, please notify the sender immediately by replying to > this message and deleting the material from any computer. > > -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ |