Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Is continuous map reduce supported


Copy link to this message
-
Re: Is continuous map reduce supported
Dead link:

http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred/lib/ChainReducer.html

On Wed, Sep 1, 2010 at 9:56 AM, Owen O'Malley <[EMAIL PROTECTED]> wrote:
> On Wed, Sep 1, 2010 at 3:35 AM, Jeff Hammerbacher <[EMAIL PROTECTED]> wrote:
>>
>> There have been several proposals for implementing such a feature.
>
> Thanks for the great breakdown of the relevant work.
>
>> As for actually being implemented in Hadoop MapReduce: the Apache project
>> seems to have settled in to focus on stability rather than evolving new
>> features.
>
> That isn't true. We are actively adding new features. However, there
> is certainly a focus on doing MapReduce well rather than trying to
> implement all potential distributed computation paradigms. I suspect
> that the right solution is doing two levels like Mesos:
>
> http://www.eecs.berkeley.edu/Pubs/TechRpts/2010/EECS-2010-87.html
>
> Where MapReduce is one framework running on the cluster. That way you
> can keep the framework stable, support MapReduce well, and let other
> users explore other idioms.
>
> -- Owen
>

--
Lance Norskog
[EMAIL PROTECTED]
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB