Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # general - Number of Mappers


Copy link to this message
-
Re: Number of Mappers
Jeff Zhang 2010-09-15, 01:22
Hi Rahul,

You can not determined set the mapper number as reducer number. The
mapper number is determined by the your InputFormat. If you are using
PigStorage, then the InputFormat is PigTextInputFormat which is a
subclass of TextInputFormat. You can refer TextInputFormat.getSplits()
to see how it split the input.

On Wed, Sep 15, 2010 at 1:24 AM, Rahul Malviya <[EMAIL PROTECTED]> wrote:
> Hi
>
> I am using Pig jobs to run on Hadoop but always it runs 4 mappers simultaneously.
>
> How can I increase the number of simultaneous mappers to run ?
>
> What config do I have to change ?
>
> Thanks,
> Rahul

--
Best Regards

Jeff Zhang