Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Reducer to output only json


Copy link to this message
-
Re: Reducer to output only json
If you need to save the JSON as it is then you could implement OutputFormat
to create you custom outputformat that'll allow you to write the data as
per your wish.

Warm Regards,
Tariq
cloudfront.blogspot.com
On Tue, Jun 4, 2013 at 11:39 PM, Chengi Liu <[EMAIL PROTECTED]> wrote:

> Hi,
>
>  I have the following redcuer class
>
> public static class TokenCounterReducer
>     extends Reducer<Text, Text, Text, Text> {
>     public void reduce(Text key, Iterable<Text> values, Context context)
>         throws IOException, InterruptedException {
>
>     //String[] fields = s.split("\t", -1)
>     JSONObject jsn = new JSONObject();
>         int sum = 0;
>         for (Text value : values) {
>         String[] vals = value.toString().split("\t");
>         String[] targetNodes = vals[0].toString().split(",",-1);
>         jsn.put("source",vals[1] );
>         jsn.put("target",targetNodes);
>             //sum += value.get();
>         }
>        // context.write(key, new Text(sum));
>     }
> }
>
> I want to save that json to hdfs?
>
> It was very trivial in hadoop streaming.. but how do i do it in hadoop
> java?
> Thanks
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB