Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Re: Multiple mappers, different parameter values

Copy link to this message
Re: Multiple mappers, different parameter values
Hi Mirko,

Thanks for the reply.

Yeah that's one solution.

On 04/02/2013 10:04 AM, Mirko K�mpf wrote:
> Hi,
> I would add an id to the parameter name: "num.iterations.ID
> <http://num.iterations.ID>=something"
> If your mapper knows what ID it has it can just pick up this value
> from the context. But the question is:
> How does the mapper know about it's ID? Is it related to the input?
> Thank it can be calculated but this is
> a domain specific issue.
> Best wishes
> Mirko
> 2013/4/2 Abhinav M Kulkarni <[EMAIL PROTECTED]
> <mailto:[EMAIL PROTECTED]>>
>     Hi,
>     I have a situation wherein I have multiple mappers. I am using
>     MultipleInputs class to add them.
>     Now, I need to pass different parameters to different mappers. For
>     e.g. lets say I have a parameter 'num.iterations' that is set
>     differently for different mappers. One way to pass parameters to
>     mappers is to set them in a Configuration object:
>     Configuration conf = new Configuration();
>     conf.set("num.iterations", "100");
>     However using this I can't set the value differently for different
>     mappers. How do I achieve this?
>     Thanks,
>     Abhinav