Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Maps split size


Copy link to this message
-
Re: Maps split size
Hi Mark,

I think http://wiki.apache.org/hadoop/HowManyMapsAndReduces might interest
you.
If you require more information, feel free to ask after reading it.

Regards

Bertrand

On Fri, Oct 26, 2012 at 10:47 PM, Mark Olimpiati <[EMAIL PROTECTED]>wrote:

> Hi,
>
>   I've found that the solution to control the split size per mapper is to
> modify the following configurations:
>
> mapred.min.split.size and mapred.max.split.size, but when I set them both
> to 14MB with dfs.block.size = 64MB, the splits are still = 64MB.
>
> So, is there a relation between them that I should consider?
>
> Thank you,
> Mark
>

--
Bertrand Dechoux