Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Why Hadoop uses HTTP for file transmission between Map and Reduce?


Copy link to this message
-
Re: Why Hadoop uses HTTP for file transmission between Map and Reduce?
Hi,
----- Original Message ----
> From: Owen O'Malley <[EMAIL PROTECTED]>
>
> At some point, we'll replace Jetty in the shuffle, because it imposes  too
> much overhead and go to Netty or some other lower level library. I  don't
> think that using HTTP adds that much overhead although it would  be
> interesting to measure that.

I use Jetty in a lot of places, so I'm curious about this Jetty + overhead
comment.  Could you please share more info about what sort of overhead you are
referring to? (also, does it apply to all recent versions of Jetty - 6, 7, and
8?)

Thanks,
Otis
----
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Hadoop ecosystem search :: http://search-hadoop.com/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB