Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Start time, end time, and task tracker of individual tasks of a job


+
Jeff LI 2012-11-20, 16:13
Copy link to this message
-
Re: Start time, end time, and task tracker of individual tasks of a job
Harsh J 2012-11-20, 17:15
Hey Jeff,

Yes, we expose some information for each task completion event..

For Old API, use RunningJob, specifically:
http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapred/RunningJob.html#getTaskCompletionEvents(int)

For New API, use Job, specifically:
http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapreduce/Job.html#getTaskCompletionEvents(int)

On Tue, Nov 20, 2012 at 9:43 PM, Jeff LI <[EMAIL PROTECTED]> wrote:
> Hello,
>
> Is there a way to obtain the information of each individual task of a
> map-reduce job, including start time, end time, which task tracker runs this
> task and so on?
>
> I know this information can be found through the web interface running on
> the jobtracter.  But is it possible to redirect the information to a nicely
> formatted log file for each job?
>
> By the way, I'm running hadoop 0.20.2-cdh3u5.
>
> Thanks advance for the help.
>
> Cheers
>
> Jeff
>

--
Harsh J