Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Maps split size

Copy link to this message
Re: Maps split size
Hi Mark,

I think http://wiki.apache.org/hadoop/HowManyMapsAndReduces might interest
If you require more information, feel free to ask after reading it.



On Fri, Oct 26, 2012 at 10:47 PM, Mark Olimpiati <[EMAIL PROTECTED]>wrote:

> Hi,
>   I've found that the solution to control the split size per mapper is to
> modify the following configurations:
> mapred.min.split.size and mapred.max.split.size, but when I set them both
> to 14MB with dfs.block.size = 64MB, the splits are still = 64MB.
> So, is there a relation between them that I should consider?
> Thank you,
> Mark

Bertrand Dechoux