Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Mapper basic question


+
Manoj Babu 2012-07-11, 12:29
Copy link to this message
-
Re: Mapper basic question
Take a look at CombineFileInputFormat - this will create 'meta splits' which include multiple small spilts, thus reducing #maps which are run.

Arun

On Jul 11, 2012, at 5:29 AM, Manoj Babu wrote:

> Hi,
>
> The no of mappers is depends on the no of blocks. Is it possible to limit the no of mappers size without increasing the HDFS block size?
>
> Thanks in advance.
>
> Cheers!
> Manoj.
>

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
+
Manoj Babu 2012-07-11, 12:47
+
Bejoy KS 2012-07-11, 13:36
+
Manoj Babu 2012-07-11, 15:02
+
Mohammad Tariq 2012-07-11, 12:33
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB