Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Re: Multiple mappers, different parameter values


Copy link to this message
-
Re: Multiple mappers, different parameter values
Hi Mirko,

Thanks for the reply.

Yeah that's one solution.

--
Abhinav
On 04/02/2013 10:04 AM, Mirko K�mpf wrote:
> Hi,
>
> I would add an id to the parameter name: "num.iterations.ID
> <http://num.iterations.ID>=something"
> If your mapper knows what ID it has it can just pick up this value
> from the context. But the question is:
> How does the mapper know about it's ID? Is it related to the input?
> Thank it can be calculated but this is
> a domain specific issue.
>
> Best wishes
> Mirko
>
>
> 2013/4/2 Abhinav M Kulkarni <[EMAIL PROTECTED]
> <mailto:[EMAIL PROTECTED]>>
>
>     Hi,
>
>     I have a situation wherein I have multiple mappers. I am using
>     MultipleInputs class to add them.
>
>     Now, I need to pass different parameters to different mappers. For
>     e.g. lets say I have a parameter 'num.iterations' that is set
>     differently for different mappers. One way to pass parameters to
>     mappers is to set them in a Configuration object:
>
>     Configuration conf = new Configuration();
>     conf.set("num.iterations", "100");
>
>     However using this I can't set the value differently for different
>     mappers. How do I achieve this?
>
>     Thanks,
>     Abhinav
>
>

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB