Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> [DISCUSS] Spin out MR, HDFS and YARN as their own TLPs and disband Hadoop umbrella project


Copy link to this message
-
Re: [DISCUSS] Spin out MR, HDFS and YARN as their own TLPs and disband Hadoop umbrella project
Andrew,

On Sep 1, 2012, at 6:32 AM, Andrew Purtell wrote:

> I'd imagine such a MR(v1) in Hadoop, if this happened, would concentrate on
> performance improvements, maybe such things as alternate shuffle plugins.
> Perhaps a HA JobTracker for parity with HDFS.

Lots of this has already happened in branch-1, please look at:
# JT Availability: MAPREDUCE-3837, MAPREDUCE-4328, MAPREDUCE-4603 (WIP)
# Performance - backports of PureJavaCrc32 in spills (MAPREDUCE-782), fadvise backports (MAPREDUCE-3289) and other several misc. fixes.

thanks,
Arun