Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Is continuous map reduce supported


+
Stephen Mullins 2010-08-24, 16:55
+
Harsh J 2010-08-24, 18:05
+
Jeff Hammerbacher 2010-09-01, 10:35
+
Owen OMalley 2010-09-01, 16:56
Copy link to this message
-
Re: Is continuous map reduce supported
Dead link:

http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred/lib/ChainReducer.html

On Wed, Sep 1, 2010 at 9:56 AM, Owen O'Malley <[EMAIL PROTECTED]> wrote:
> On Wed, Sep 1, 2010 at 3:35 AM, Jeff Hammerbacher <[EMAIL PROTECTED]> wrote:
>>
>> There have been several proposals for implementing such a feature.
>
> Thanks for the great breakdown of the relevant work.
>
>> As for actually being implemented in Hadoop MapReduce: the Apache project
>> seems to have settled in to focus on stability rather than evolving new
>> features.
>
> That isn't true. We are actively adding new features. However, there
> is certainly a focus on doing MapReduce well rather than trying to
> implement all potential distributed computation paradigms. I suspect
> that the right solution is doing two levels like Mesos:
>
> http://www.eecs.berkeley.edu/Pubs/TechRpts/2010/EECS-2010-87.html
>
> Where MapReduce is one framework running on the cluster. That way you
> can keep the framework stable, support MapReduce well, and let other
> users explore other idioms.
>
> -- Owen
>

--
Lance Norskog
[EMAIL PROTECTED]
+
Ted Yu 2010-09-02, 03:48
+
Jeff Hammerbacher 2010-09-03, 05:13
+
Wei Xue 2010-09-03, 06:01
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB