Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> speculative execution before mappers finish


Copy link to this message
-
speculative execution before mappers finish
Is it possible for reducers to start (not just copying, but actually)
"reducing" before all mappers are done, speculatively?

In particular im asking this because Im curious about the internals of how
the shuffle and sort might (or might not :)) be able to support this.
+
Harsh J 2012-10-13, 04:44
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB