Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Reducer to output only json


Copy link to this message
-
Reducer to output only json
Chengi Liu 2013-06-04, 18:09
Hi,

 I have the following redcuer class

public static class TokenCounterReducer
    extends Reducer<Text, Text, Text, Text> {
    public void reduce(Text key, Iterable<Text> values, Context context)
        throws IOException, InterruptedException {

    //String[] fields = s.split("\t", -1)
    JSONObject jsn = new JSONObject();
        int sum = 0;
        for (Text value : values) {
        String[] vals = value.toString().split("\t");
        String[] targetNodes = vals[0].toString().split(",",-1);
        jsn.put("source",vals[1] );
        jsn.put("target",targetNodes);
            //sum += value.get();
        }
       // context.write(key, new Text(sum));
    }
}

I want to save that json to hdfs?

It was very trivial in hadoop streaming.. but how do i do it in hadoop java?
Thanks
+
Mohammad Tariq 2013-06-04, 19:53
+
Niels Basjes 2013-06-04, 20:08
+
Mohammad Tariq 2013-06-04, 20:15