-Re: Tracking Job completion times
bejoy.hadoop@... 2012-03-04, 22:46
You could be getting detailed metrics on a per job basis from the jobtracker web UI
If you drill down you can get still further details on task levels .
Bejoy K S
>From handheld, Please excuse typos.
From: Bharath Ravi <[EMAIL PROTECTED]>
Date: Sun, 4 Mar 2012 17:39:01
To: <[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Tracking Job completion times
I'd like to log and monitor average job completion times on hadoop.
(For example, wall time from the perspective of the JobTracker)
What might be the best way to do this?
I see a lot of metrics exported through the metrics2 interface:
are job completion times part of this? Is there documentation I could read
to understand the exported jobtracker/tasktracker metrics?
Thanks a lot!