Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> running Combiner for all the task on the node.


Copy link to this message
-
Re: running Combiner for all the task on the node.
Hi Suresh,

This has been in good progress for a while, please see
https://issues.apache.org/jira/browse/MAPREDUCE-4502 and sub-tasks.

On Wed, Jan 2, 2013 at 5:53 PM, Suresh S <[EMAIL PROTECTED]> wrote:
> Hello,
>
>       I think, running combiner function at node level (to combine all the
> map task output of the node) may reduce the intermediate data movement.
>
>      I don't know this technique is already available or not. Is it worth
> for working in this direction?
> Any suggestions? Thanks in advance.
> *Regards*
> *S.Suresh,*
> *Research Scholar,*
> *Department of Computer Applications,*
> *National Institute of Technology,*
> *Tiruchirappalli - 620015.*
> *+91-9941506562*

--
Harsh J
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB