Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Re: newbie question


+
Serge Blazhiyevskyy 2013-01-16, 01:30
+
jamal sasha 2013-01-16, 01:31
Copy link to this message
-
Re: newbie question
jamal sasha 2013-01-16, 02:03
Hi,
 The relevant code snippet posted here
http://pastebin.com/DRPXUm62
On Tue, Jan 15, 2013 at 5:31 PM, jamal sasha <[EMAIL PROTECTED]> wrote:

> My bad. Sorry I fixed it. It is BuildGraph.class
>
>
> On Tue, Jan 15, 2013 at 5:30 PM, Serge Blazhiyevskyy <
> [EMAIL PROTECTED]> wrote:
>
>> Don't you need to set this
>>
>>      conf.setMapperClass(Mapper.class);
>>
>> to BuildGraph?
>>
>>
>> Serge
>>
>>
>> SERGE BLAZHIYEVSKY
>> Architect
>> (T) +1 (650) 226-0511
>> (M) +1 (408) 772-2615
>> [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
>> www.nice.com<http://www.nice.com>
>>
>>
>> On Jan 15, 2013, at 5:24 PM, jamal sasha <[EMAIL PROTECTED]<mailto:
>> [EMAIL PROTECTED]>> wrote:
>>
>> I have a mapper
>>
>>
>>     public class BuildGraph{
>>        public void config(JobConf job){ <==this block doesnt seems to be
>> exexcuting at all :(
>>         super.configure(job);
>>         this.currentId = job.getInt("currentId",0);
>>         if (this.currentId!=0){
>>         // I call a method from differnt class to build a distributed
>> cache
>>         }
>>        }
>>       public void map(....){
>>     ....
>>     }
>> }
>>
>> now the main code where this is called..
>>
>>     public void run( String params,curId){
>>      JobConf conf = new JobConf(classname.class);
>>      conf.setInt("currentId",299); <--note this i am setting the value
>> here
>>      conf.setMapperClass(Mapper.class);
>>      //....
>>       JobClient.runJob(conf);
>>     }
>>
>> But the problem is config method in the code is not executing as though
>> "currentId" returns 299 in main loop but it is not set at all in the mapper
>> class.
>> what am i doing wrong
>>
>>
>