Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Why they recommend this (CPU) ?

Copy link to this message
Re: Why they recommend this (CPU) ?
Jay Vyas 2012-10-11, 17:46
Presumably, if you have a reasonable number of cores - speeding the cores
up will be better than forking a task into smaller and smaller chunks -
because at some point the overhead of multiple processes would be a
bottleneck - maybe due to streaming reads and writes?  I'm sure each and
every problem has a different sweet spot.