Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Modify the number of map tasks


Copy link to this message
-
Modify the number of map tasks
Hi,

I try to force the number of map for the mapreduce job with the command :
  public static void main(String[] args) throws Exception {

          JobConf conf = new JobConf(WordCount.class);
             conf.set("mapred.job.tracker", "local");
         conf.set("fs.default.name", "local");
          conf.setJobName("wordcount");

          conf.setOutputKeyClass(Text.class);
         conf.setOutputValueClass(IntWritable.class);

           conf.setNumMapTask(6);
          conf.setMapperClass(Map.class);
          conf.setCombinerClass(Reduce.class);
          conf.setReducerClass(Reduce.class);
...
}

But it doesn t work.
What can i do to modify the number of map and reduce tasks.

Thank you
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB