Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> combiner without reducer


Copy link to this message
-
Re: combiner without reducer
Please open a jira, we can discuss.

Also, you might want to look at Apache Tez - one could easily get it to work with a bit of hacking.

thanks,
Arun

On Apr 15, 2013, at 11:07 PM, Radim Kolar wrote:

> i have need for running combiner without reducers.
>
> Workflow mapper -> sort -> combiner -> hdfs.
>
> do you think that you will ever support that scenario? Its quite common because few hadoop frameworks supports it, but they emulate it in mapper by caching results into memory.

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB