Home
|
About
|
Sematext
search-lucene.com
search-hadoop.com
Search Hadoop
and all its subprojects:
Search
Switch to Plain View
Hadoop, mail # user - get result parameters of finished hadoop job
Oleg Ruchovets
2011-08-09, 15:18
-
get result parameters of finished hadoop job
Oleg Ruchovets 2011-08-09, 15:18
Hi , I want to get result information of finished hadoop job. Currently I
can see it using hadoop admin web console.
For example:
Kind% CompleteNum TasksPendingRunningCompleteKilledFailed/Killed
Task Attempts<
http://hadoop-master.infolinks.local:8021/jobfailures.jsp?jobid=job_201108071903_0036>
map<
http://hadoop-master.infolinks.local:8021/jobtasks.jsp?jobid=job_201108071903_0036&type=map&pagenum=1>
100.00%54500545<
http://hadoop-master.infolinks.local:8021/jobtasks.jsp?jobid=job_201108071903_0036&type=map&pagenum=1&state=completed>
00 / 18<
http://hadoop-master.infolinks.local:8021/jobfailures.jsp?jobid=job_201108071903_0036&kind=map&cause=killed>
reduce<
http://hadoop-master.infolinks.local:8021/jobtasks.jsp?jobid=job_201108071903_0036&type=reduce&pagenum=1>
100.00%180018<
http://hadoop-master.infolinks.local:8021/jobtasks.jsp?jobid=job_201108071903_0036&type=reduce&pagenum=1&state=completed>
00 / 4<
http://hadoop-master.infolinks.local:8021/jobfailures.jsp?jobid=job_201108071903_0036&kind=reduce&cause=killed>
CounterMapReduceTotalJob CountersLaunched reduce tasks0022Rack-local map
tasks004Launched map tasks00563Data-local map tasks00559
But for my use case I need a way (api) to get this information from external
java application.
Question: Does hadoop provide API (or another way) to get result information
about hadoop jobs?
Thanks In Advance
Oleg.
+
Oleg Ruchovets 2011-08-09, 15:18
All projects made searchable here are trademarks of the Apache Software Foundation. Service operated by
Sematext