Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Analysing Completed Job info programmatically apart from Jobtracker GUI

Copy link to this message
Re: Analysing Completed Job info programmatically apart from Jobtracker GUI
I would check out hitune. I have a github project that connects to the
JobTracker and stores counters, job times and other stats into Cassandra.


Worth checking out as discovering how to connect and mine information from
the JobTracker was quite fun.


On Wed, Dec 14, 2011 at 9:40 AM, ArunKumar <[EMAIL PROTECTED]> wrote:

> Hi Guys !
> I want to analyse the completed Job counters like FILE/HDFS BYTES
> READ/WRITTEN along with other values like average map/reduce task run time.
> I see that Jobtracker GUI has this info but i want to programmatically
> retrieve these values instead of manually noting down these values and do
> some analysis. Can i do it in a simple/easier way ?
> I also see that Cloudera's HUE is good for this but is there anything
> equivalent in Hadoop.
> Can anyone guide me in this regard ?
> Arun
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Analysing-Completed-Job-info-programmatically-apart-from-Jobtracker-GUI-tp3585629p3585629.html
> Sent from the Hadoop lucene-users mailing list archive at Nabble.com.