Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> map task execution time


+
bikash sharma 2012-04-04, 21:20
+
Luca Pireddu 2012-04-06, 09:23
+
Kai Voigt 2012-04-05, 07:15
+
bikash sharma 2012-04-05, 12:30
Copy link to this message
-
Re: map task execution time
How can "hadoop job" be used to read m/r statistics ?

On Thu, Apr 5, 2012 at 7:30 AM, bikash sharma <[EMAIL PROTECTED]>wrote:

> Thanks Kai, I will try those.
>
> On Thu, Apr 5, 2012 at 3:15 AM, Kai Voigt <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > Am 05.04.2012 um 00:20 schrieb bikash sharma:
> >
> > > Is it possible to get the execution time of the constituent map/reduce
> > > tasks of a MapReduce job (say sort) at the end of a job run?
> > > Preferably, can we obtain this programatically?
> >
> >
> > you can access the JobTracker's web UI and see the start and stop
> > timestamps for every individual task.
> >
> > Since the JobTracker Java API is exposed, you can write your own
> > application to fetch that data through your own code.
> >
> > Also, "hadoop job" on the command line can be used to read job
> statistics.
> >
> > Kai
> >
> >
> > --
> > Kai Voigt
> > [EMAIL PROTECTED]
> >
> >
> >
> >
> >
>

--
Jay Vyas
MMSB/UCHC
+
Jay Vyas 2012-04-05, 13:02
+
bikash sharma 2012-04-05, 13:44