|
|
Alan Miller 2010-05-09, 19:16
Hi,
I have class that I run on the master node and submits a bunch of MR jobs to my cluster but how can I tell where each job actually executed? I'm using Cloudera's 0.20.2+228.
I don't see any commands or pages in the GUI that tell me this.
Looks like there are some classes that might provide programatic access to this but as a newbie to hadoop it's kinda hard figuring out which ones to use since the API changed and there alot of duplicate/deprecated classes lying around.
Thanks, Alan
InetAddress.getLocalHost() should give you the hostname for each mapper/reducer
On Sun, May 9, 2010 at 12:16 PM, Alan Miller <[EMAIL PROTECTED]>wrote:
> Hi, > > I have class that I run on the master node and submits > a bunch of MR jobs to my cluster but how can I tell where > each job actually executed? I'm using Cloudera's 0.20.2+228. > > I don't see any commands or pages in the GUI that tell me this. > > Looks like there are some classes that might provide programatic > access to this but as a newbie to hadoop it's kinda hard figuring out > which ones to use since the API changed and there alot of > duplicate/deprecated classes lying around. > > Thanks, > Alan >
Jeff Zhang 2010-05-10, 01:06
Do you mean where each task run ? You can look at the job tracker web ui where you can find each job's status and info.
On Mon, May 10, 2010 at 3:16 AM, Alan Miller <[EMAIL PROTECTED]> wrote: > Hi, > > I have class that I run on the master node and submits > a bunch of MR jobs to my cluster but how can I tell where > each job actually executed? I'm using Cloudera's 0.20.2+228. > > I don't see any commands or pages in the GUI that tell me this. > > Looks like there are some classes that might provide programatic > access to this but as a newbie to hadoop it's kinda hard figuring out > which ones to use since the API changed and there alot of > duplicate/deprecated classes lying around. > > Thanks, > Alan >
-- Best Regards
Jeff Zhang
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext