Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> cannot submit a job via java client in hadoop- 2.0.5-alpha

Copy link to this message
RE: cannot submit a job via java client in hadoop- 2.0.5-alpha
'yarn.nodemanager.address' is not required to submit the Job, it will be required only in NM side.
Devaraj k

From: Azuryy Yu [mailto:[EMAIL PROTECTED]]
Sent: 10 July 2013 16:22
Subject: Re: cannot submit a job via java client in hadoop- 2.0.5-alpha

you didn't set yarn.nodemanager.address in your yarn-site.xml

On Wed, Jul 10, 2013 at 4:33 PM, Francis.Hu <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

I have a hadoop- 2.0.5-alpha cluster with 3 data nodes . I have Resource Manager and all data nodes started and can access web ui of Resource Manager.
I wrote a java client to submit a job as TestJob class below. But the job is never submitted successfully. It throws out exception all the time.
My configurations are attached.  Can anyone help me? Thanks.

---------my-java client
public class TestJob {

    public void execute() {

        Configuration conf1 = new Configuration();
        JobConf conf = new JobConf(conf1);





        FileInputFormat.setInputPaths(conf,new Path("/home/francis/hadoop-jobs/2013070907.FNODE.2.txt"));
        FileOutputFormat.setOutputPath(conf, new Path("/home/francis/hadoop-jobs/result/"));

        try {
            JobClient client = new JobClient(conf);
            RunningJob job = client.submitJob(conf);
        } catch (IOException e) {


jvm 1    | java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name<http://mapreduce.framework.name> and the correspond server addresses.
jvm 1    |      at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:119)
jvm 1    |      at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:81)
jvm 1    |      at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:74)
jvm 1    |      at org.apache.hadoop.mapred.JobClient.init(JobClient.java:482)
jvm 1    |      at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:461)
jvm 1    |      at com.rh.elastic.hadoop.job.TestJob.execute(TestJob.java:59)