This would seem like a perfect use case for YARN. Is that what you are
thinking?  You could implement this as a new framework rather then
trying to incrementally change map-reduce.

This would let you move faster and demonstrate side by side
performance improvements.

---
E14 - typing on glass

On May 8, 2012, at 10:32 AM, Sriram Rao <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB