-Re: Getting Giraph to build/run with CDH4 (cannot initialize cluster - check mapreduce.framework.name)
Arun C Murthy 2013-02-26, 00:18
Pls ask CDH lists.
On Feb 25, 2013, at 8:26 AM, David Boyd wrote:
> I am trying to get the Giraph 0.2 snapshot (pulled via GIT on Friday)
> to build and run with CDH4.
> I modified the pom.xml to provide a profile for my specific version (4.1.1).
> The build works (mvn -Phadoop_cdh4.1.1 clean package test) and passes
> all the tests.
> If I try to do the next step and submit to my cluster with the command:
> mvn -Phadoop_cdh4.1.1 test -Dprop.mapred.job.tracker=10.1.94.53:8021 -Dgiraph.zkList=10.1.94.104:2181
> the JSON test in core fails. If I move that test out of the way a whole bunch of tests in examples
> fail. They all fail with:
>> java.io.IOException: Cannot initialize Cluster. Please check your
>> configuration for mapreduce.framework.name and the correspond server
> I have tried passing mapreduce.framework.name as both local and classic. I have also set those values in my mapreduce-site.xml.
> Interestingly I can run the pagerank benchmark in code with the command:
>> hadoop jar
>> -Dmapred.child.java-opts="-Xmx64g -Xms64g XX:+UseConcMarkSweepGC
>> -XX:-UseGCOverheadLimit" -Dgiraph.zkList=10.1.94.104:2181 -e 1 -s 3 -v
>> -V 50000 -w 83
> And it completes just fine.
> I have searched high and low for documents and examples on how to run the example programs from other
> than maven but have not found any thing.
> Any help or suggestions would be greatly appreciated.
> ========= mailto:[EMAIL PROTECTED] ===========> David W. Boyd
> Director, Engineering, Research and Development
> Data Tactics Corporation
> 7901 Jones Branch, Suite 240
> Mclean, VA 22102
> office: +1-703-506-3735, ext 308
> fax: +1-703-506-6703
> cell: +1-703-402-7908
> ============== http://www.data-tactics.com/ ===========>
> The information contained in this message may be privileged
> and/or confidential and protected from disclosure.
> If the reader of this message is not the intended recipient
> or an employee or agent responsible for delivering this message
> to the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication
> is strictly prohibited. If you have received this communication
> in error, please notify the sender immediately by replying to
> this message and deleting the material from any computer.
Arun C. Murthy