Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Reducer to output only json

Copy link to this message
Reducer to output only json

 I have the following redcuer class

public static class TokenCounterReducer
    extends Reducer<Text, Text, Text, Text> {
    public void reduce(Text key, Iterable<Text> values, Context context)
        throws IOException, InterruptedException {

    //String[] fields = s.split("\t", -1)
    JSONObject jsn = new JSONObject();
        int sum = 0;
        for (Text value : values) {
        String[] vals = value.toString().split("\t");
        String[] targetNodes = vals[0].toString().split(",",-1);
        jsn.put("source",vals[1] );
            //sum += value.get();
       // context.write(key, new Text(sum));

I want to save that json to hdfs?

It was very trivial in hadoop streaming.. but how do i do it in hadoop java?