Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Re: Getting Giraph to build/run with CDH4 (cannot initialize cluster - check mapreduce.framework.name)


Copy link to this message
-
Re: Getting Giraph to build/run with CDH4 (cannot initialize cluster - check mapreduce.framework.name)
Pls ask CDH lists.

On Feb 25, 2013, at 8:26 AM, David Boyd wrote:

> All:
>   I am trying to get the Giraph 0.2 snapshot (pulled via GIT on Friday)
> to build and run with CDH4.
>
> I modified the pom.xml to provide a profile for my specific version (4.1.1).
> The build works (mvn -Phadoop_cdh4.1.1 clean package test) and passes
> all the tests.
>
> If I try to do the next step and submit to my cluster with the command:
> mvn -Phadoop_cdh4.1.1 test -Dprop.mapred.job.tracker=10.1.94.53:8021 -Dgiraph.zkList=10.1.94.104:2181
>
> the JSON test in core fails.  If I move that test out of the way a whole bunch of tests in examples
> fail.  They all fail with:
>> java.io.IOException: Cannot initialize Cluster. Please check your
>> configuration for mapreduce.framework.name and the correspond server
>> addresses.
>
> I have tried passing mapreduce.framework.name as both local and classic.   I have also set those values in my mapreduce-site.xml.
>
> Interestingly I can run the pagerank benchmark in code with the command:
>> hadoop jar
>> ./giraph-core/target/giraph-0.2-SNAPSHOT-for-hadoop-2.0.0-cdh4.1.3-jar-with-dependencies.jar
>> org.apache.giraph.benchmark.PageRankBenchmark
>> -Dmapred.child.java-opts="-Xmx64g -Xms64g XX:+UseConcMarkSweepGC
>> -XX:-UseGCOverheadLimit" -Dgiraph.zkList=10.1.94.104:2181 -e 1 -s 3 -v
>> -V 50000 -w 83
> And it completes just fine.
>
> I have searched high and low for documents and examples on how to run the example programs from other
> than maven but have not found any thing.
>
> Any help or suggestions  would be greatly appreciated.
>
> THanks.
>
>
>
> --
> ========= mailto:[EMAIL PROTECTED] ===========> David W. Boyd
> Director, Engineering, Research and Development
> Data Tactics Corporation
> 7901 Jones Branch, Suite 240
> Mclean, VA 22102
> office:   +1-703-506-3735, ext 308
> fax:     +1-703-506-6703
> cell:     +1-703-402-7908
> ============== http://www.data-tactics.com/ ===========>
> The information contained in this message may be privileged
> and/or confidential and protected from disclosure.
> If the reader of this message is not the intended recipient
> or an employee or agent responsible for delivering this message
> to the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication
> is strictly prohibited.  If you have received this communication
> in error, please notify the sender immediately by replying to
> this message and deleting the material from any computer.
>
>

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB