Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Mapper basic question

Copy link to this message
Re: Mapper basic question
Take a look at CombineFileInputFormat - this will create 'meta splits' which include multiple small spilts, thus reducing #maps which are run.


On Jul 11, 2012, at 5:29 AM, Manoj Babu wrote:

> Hi,
> The no of mappers is depends on the no of blocks. Is it possible to limit the no of mappers size without increasing the HDFS block size?
> Thanks in advance.
> Cheers!
> Manoj.

Arun C. Murthy
Hortonworks Inc.