Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> ISSUE while configuring ECLIPSE with MAP-REDUCE


Copy link to this message
-
ISSUE while configuring ECLIPSE with MAP-REDUCE

Hi Hadoop Champs,

I am facing this issue while trying to configure Eclipse with Map-Reduce.

Exception in thread "main" java.lang.Error: Unresolved compilation problems:
    The method setInputFormat(Class<? extends InputFormat>) in the type JobConf is not applicable for the arguments (Class<TextInputFormat>)
    The method setOutputFormat(Class<? extends OutputFormat>) in the type JobConf is not applicable for the arguments (Class<TextOutputFormat>)
    The method setInputPaths(Job, String) in the type FileInputFormat is not applicable for the arguments (JobConf, Path)
    The method setOutputPath(Job, Path) in the type FileOutputFormat is not applicable for the arguments (JobConf, Path)

    at TestDriver.main(TestDriver.java:30)
I have these classes and flow pattern.
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapred.JobClient;
import org.apache.hadoop.mapred.JobConf;
import org.apache.hadoop.mapred.Mapper;
import org.apache.hadoop.mapred.Reducer;
import org.apache.hadoop.mapreduce.lib.input.TextInputFormat;
import org.apache.hadoop.mapreduce.lib.output.TextOutputFormat;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter;

public class TestDriver {

    public static void main(String[] args) {
        JobClient client = new JobClient();
        JobConf conf = new JobConf(TestDriver.class);

        // TODO: specify output types
        conf.setOutputKeyClass(Text.class);
        conf.setOutputValueClass(IntWritable.class);

        // TODO: specify input and output DIRECTORIES (not files)
        //conf.setInputPath(new Path("src"));
        //conf.setOutputPath(new Path("out"));
        
        conf.setInputFormat(TextInputFormat.class);  /*   ERROR shown is :: The method setInputFormat(Class<? extends InputFormat>) in the type JobConf is not applicable for the  arguments (Class<TextInputFormat>) */

        conf.setOutputFormat(TextOutputFormat.class);   /*  ERROR shown is :: The method setOutputFormat(Class<? extends OutputFormat>) in the type JobConf is not applicable for the  arguments (Class<TextOutputFormat>)  */

        FileInputFormat.setInputPaths(conf, new Path("In"));  /* ERROR shown is ::  The method setInputPaths(Job, String) in the type FileInputFormat is not applicable for the arguments (JobConf, Path)  */
        FileOutputFormat.setOutputPath(conf, new Path("Out"));  /* ERROR shown is :: The method setOutputPath(Job, Path) in the type FileOutputFormat is not applicable for the arguments (JobConf, Path)   */
        // TODO: specify a mapper
        conf.setMapperClass(org.apache.hadoop.mapred.lib.IdentityMapper.class);

        // TODO: specify a reducer
        conf.setReducerClass(org.apache.hadoop.mapred.lib.IdentityReducer.class);

        client.setConf(conf);
        try {
            JobClient.runJob(conf);
        } catch (Exception e) {
            e.printStackTrace();
        }
    }

}
Please suggest & Help

Thanks & Regards
Yogesh Kumar

     
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB