Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Why Hadoop uses HTTP for file transmission between Map and Reduce?


Copy link to this message
-
Re: Why Hadoop uses HTTP for file transmission between Map and Reduce?
Otis Gospodnetic 2011-01-16, 07:21
Hi,
----- Original Message ----
> From: Owen O'Malley <[EMAIL PROTECTED]>
>
> At some point, we'll replace Jetty in the shuffle, because it imposes  too
> much overhead and go to Netty or some other lower level library. I  don't
> think that using HTTP adds that much overhead although it would  be
> interesting to measure that.

I use Jetty in a lot of places, so I'm curious about this Jetty + overhead
comment.  Could you please share more info about what sort of overhead you are
referring to? (also, does it apply to all recent versions of Jetty - 6, 7, and
8?)

Thanks,
Otis
----
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Hadoop ecosystem search :: http://search-hadoop.com/