Hello,

Is there a way to obtain the information of each individual task of a
map-reduce job, including start time, end time, which task tracker runs
this task and so on?

I know this information can be found through the web interface running on
the jobtracter.  But is it possible to redirect the information to a nicely
formatted log file for each job?

By the way, I'm running hadoop 0.20.2-cdh3u5.

Thanks advance for the help.

Cheers

Jeff

Hey Jeff,

Yes, we expose some information for each task completion event..

For Old API, use RunningJob, specifically:
http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapred/RunningJob.html#getTaskCompletionEvents(int)

For New API, use Job, specifically:
http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapreduce/Job.html#getTaskCompletionEvents(int)

On Tue, Nov 20, 2012 at 9:43 PM, Jeff LI <[EMAIL PROTECTED]> wrote:
> Hello,
>
> Is there a way to obtain the information of each individual task of a
> map-reduce job, including start time, end time, which task tracker runs this
> task and so on?
>
> I know this information can be found through the web interface running on
> the jobtracter.  But is it possible to redirect the information to a nicely
> formatted log file for each job?
>
> By the way, I'm running hadoop 0.20.2-cdh3u5.
>
> Thanks advance for the help.
>
> Cheers
>
> Jeff
>

--
Harsh J