Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Re: Getting Giraph to build/run with CDH4 (cannot initialize cluster - check mapreduce.framework.name)


Copy link to this message
-
Re: Getting Giraph to build/run with CDH4 (cannot initialize cluster - check mapreduce.framework.name)
Arun C Murthy 2013-02-26, 00:18
Pls ask CDH lists.

On Feb 25, 2013, at 8:26 AM, David Boyd wrote:

> All:
>   I am trying to get the Giraph 0.2 snapshot (pulled via GIT on Friday)
> to build and run with CDH4.
>
> I modified the pom.xml to provide a profile for my specific version (4.1.1).
> The build works (mvn -Phadoop_cdh4.1.1 clean package test) and passes
> all the tests.
>
> If I try to do the next step and submit to my cluster with the command:
> mvn -Phadoop_cdh4.1.1 test -Dprop.mapred.job.tracker=10.1.94.53:8021 -Dgiraph.zkList=10.1.94.104:2181
>
> the JSON test in core fails.  If I move that test out of the way a whole bunch of tests in examples
> fail.  They all fail with:
>> java.io.IOException: Cannot initialize Cluster. Please check your
>> configuration for mapreduce.framework.name and the correspond server
>> addresses.
>
> I have tried passing mapreduce.framework.name as both local and classic.   I have also set those values in my mapreduce-site.xml.
>
> Interestingly I can run the pagerank benchmark in code with the command:
>> hadoop jar
>> ./giraph-core/target/giraph-0.2-SNAPSHOT-for-hadoop-2.0.0-cdh4.1.3-jar-with-dependencies.jar
>> org.apache.giraph.benchmark.PageRankBenchmark
>> -Dmapred.child.java-opts="-Xmx64g -Xms64g XX:+UseConcMarkSweepGC
>> -XX:-UseGCOverheadLimit" -Dgiraph.zkList=10.1.94.104:2181 -e 1 -s 3 -v
>> -V 50000 -w 83
> And it completes just fine.
>
> I have searched high and low for documents and examples on how to run the example programs from other
> than maven but have not found any thing.
>
> Any help or suggestions  would be greatly appreciated.
>
> THanks.
>
>
>
> --
> ========= mailto:[EMAIL PROTECTED] ===========> David W. Boyd
> Director, Engineering, Research and Development
> Data Tactics Corporation
> 7901 Jones Branch, Suite 240
> Mclean, VA 22102
> office:   +1-703-506-3735, ext 308
> fax:     +1-703-506-6703
> cell:     +1-703-402-7908
> ============== http://www.data-tactics.com/ ===========>
> The information contained in this message may be privileged
> and/or confidential and protected from disclosure.
> If the reader of this message is not the intended recipient
> or an employee or agent responsible for delivering this message
> to the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication
> is strictly prohibited.  If you have received this communication
> in error, please notify the sender immediately by replying to
> this message and deleting the material from any computer.
>
>

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/