Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Is there any way to set Reducer to output to multi-places?


Copy link to this message
-
答复: Is there any way to set Reducer to output to multi-places?
Hi, Rahul

 

I found the class MultipleOutputs which has to do with what I want .  It can make Reducers to write to additional outputs(File and Database in my Env.) other than the job default output.

 

http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapred/lib/MultipleOutputs.html

The class comments says below that I want to implement in my project:

 

* <p>

 * Case one: writing to additional outputs other than the job default output.

 *

 * Each additional output, or named output, may be configured with its own

 * <code>OutputFormat</code>, with its own key class and with its own value

 * class.

 * </p>

 

Anyway, thanks! Rahul. Your link leads me to the class MultipleOutputs :).

 

 

 

Thanks,

Francis.Hu.

 

 

发件人: Rahul Bhattacharjee [mailto:[EMAIL PROTECTED]]
发送时间: Monday, September 02, 2013 17:12
收件人: [EMAIL PROTECTED]
主题: Re: Is there any way to set Reducer to output to multi-places?

 

This might help

http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapred/lib/MultipleOutputFormat.html

Thanks,
Rahul

 

On Mon, Sep 2, 2013 at 2:38 PM, Francis.Hu <[EMAIL PROTECTED]> wrote:

hi, All

 

Is there any way to set Reducer to output to multi-places ?  For example: a reducer's result can be output to HDFS and Database concurrently.

 

Thanks,

Francis.Hu

 

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB