Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - map task execution time


+
bikash sharma 2012-04-04, 21:20
+
Luca Pireddu 2012-04-06, 09:23
+
Kai Voigt 2012-04-05, 07:15
+
bikash sharma 2012-04-05, 12:30
+
Jay Vyas 2012-04-05, 12:54
Copy link to this message
-
Re: map task execution time
Jay Vyas 2012-04-05, 13:02
(excuse the typo in the last email : I meant "I've been playing with Cinch"
, not "I've been with Cinch")....

On Thu, Apr 5, 2012 at 7:54 AM, Jay Vyas <[EMAIL PROTECTED]> wrote:

> How can "hadoop job" be used to read m/r statistics ?
>
> On Thu, Apr 5, 2012 at 7:30 AM, bikash sharma <[EMAIL PROTECTED]>wrote:
>
>> Thanks Kai, I will try those.
>>
>> On Thu, Apr 5, 2012 at 3:15 AM, Kai Voigt <[EMAIL PROTECTED]> wrote:
>>
>> > Hi,
>> >
>> > Am 05.04.2012 um 00:20 schrieb bikash sharma:
>> >
>> > > Is it possible to get the execution time of the constituent map/reduce
>> > > tasks of a MapReduce job (say sort) at the end of a job run?
>> > > Preferably, can we obtain this programatically?
>> >
>> >
>> > you can access the JobTracker's web UI and see the start and stop
>> > timestamps for every individual task.
>> >
>> > Since the JobTracker Java API is exposed, you can write your own
>> > application to fetch that data through your own code.
>> >
>> > Also, "hadoop job" on the command line can be used to read job
>> statistics.
>> >
>> > Kai
>> >
>> >
>> > --
>> > Kai Voigt
>> > [EMAIL PROTECTED]
>> >
>> >
>> >
>> >
>> >
>>
>
>
>
> --
> Jay Vyas
> MMSB/UCHC
>

--
Jay Vyas
MMSB/UCHC
+
bikash sharma 2012-04-05, 13:44