Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Multiple mappers, different parameter values


+
Abhinav M Kulkarni 2013-04-02, 16:46
Copy link to this message
-
Re: Multiple mappers, different parameter values
Hi,

I would add an id to the parameter name: "num.iterations.ID=something"
If your mapper knows what ID it has it can just pick up this value from the
context. But the question is:
How does the mapper know about it's ID? Is it related to the input? Thank
it can be calculated but this is
a domain specific issue.

Best wishes
Mirko
2013/4/2 Abhinav M Kulkarni <[EMAIL PROTECTED]>

>  Hi,
>
> I have a situation wherein I have multiple mappers. I am using
> MultipleInputs class to add them.
>
> Now, I need to pass different parameters to different mappers. For e.g.
> lets say I have a parameter 'num.iterations' that is set differently for
> different mappers. One way to pass parameters to mappers is to set them in
> a Configuration object:
>
> Configuration conf = new Configuration();
> conf.set("num.iterations", "100");
>
> However using this I can't set the value differently for different
> mappers. How do I achieve this?
>
> Thanks,
> Abhinav
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB