Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Maps split size


+
Mark Olimpiati 2012-10-26, 20:47
Copy link to this message
-
Re: Maps split size
Bertrand Dechoux 2012-10-26, 21:23
Hi Mark,

I think http://wiki.apache.org/hadoop/HowManyMapsAndReduces might interest
you.
If you require more information, feel free to ask after reading it.

Regards

Bertrand

On Fri, Oct 26, 2012 at 10:47 PM, Mark Olimpiati <[EMAIL PROTECTED]>wrote:

> Hi,
>
>   I've found that the solution to control the split size per mapper is to
> modify the following configurations:
>
> mapred.min.split.size and mapred.max.split.size, but when I set them both
> to 14MB with dfs.block.size = 64MB, the splits are still = 64MB.
>
> So, is there a relation between them that I should consider?
>
> Thank you,
> Mark
>

--
Bertrand Dechoux
+
Mark Olimpiati 2012-10-29, 04:25
+
Bertrand Dechoux 2012-10-29, 06:15