Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Mapper basic question


+
Manoj Babu 2012-07-11, 12:29
Copy link to this message
-
Re: Mapper basic question
Take a look at CombineFileInputFormat - this will create 'meta splits' which include multiple small spilts, thus reducing #maps which are run.

Arun

On Jul 11, 2012, at 5:29 AM, Manoj Babu wrote:

> Hi,
>
> The no of mappers is depends on the no of blocks. Is it possible to limit the no of mappers size without increasing the HDFS block size?
>
> Thanks in advance.
>
> Cheers!
> Manoj.
>

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
+
Manoj Babu 2012-07-11, 12:47
+
Bejoy KS 2012-07-11, 13:36
+
Manoj Babu 2012-07-11, 15:02
+
Mohammad Tariq 2012-07-11, 12:33