Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - is mapreduce.task.io.sort.mb control both map merge buffer and reduce merge buffer?


Copy link to this message
-
is mapreduce.task.io.sort.mb control both map merge buffer and reduce merge buffer?
ch huang 2013-12-12, 01:52
hi,maillist:
              Due to the heavy job on reduce task, i try to increase buffer
size for sort merge,i wander if i increase mapreduce.task.io.sort.mb from
100m(default value) to 1G will cause each map task  sort merge buffer also
become 1G?