Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: M/R Staticstics


Copy link to this message
-
Re: M/R Staticstics

It seems to be related to some permission problem but I am not sure how
to over come it:
2013-04-26 12:35:08,235 INFO
org.apache.hadoop.mapreduce.v2.hs.JobHistory: JobHistory Init
2013-04-26 12:35:08,886 FATAL
org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: Error starting
JobHistoryServer
org.apache.hadoop.yarn.YarnException: Error creating done directory:
[hdfs://devubuntu05:9000/tmp/hadoop-yarn/staging/history/done]
         at
org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.init(HistoryFileManager.java:424)
         at
org.apache.hadoop.mapreduce.v2.hs.JobHistory.init(JobHistory.java:87)
         at
org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
         at
org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.init(JobHistoryServer.java:87)
         at
org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:145)
. . . . .
On Fri, Apr 26, 2013 at 10:37 AM, Rishi Yadav wrote:

  do you see "retired jobs" on job tracker page. There is also "job
tracker history" on the bottom of page. 

something like this  http://nn.zettabyte.com:50030/jobtracker.jsp
<http://nn.zettabyte.com:50030/jobtracker.jsp>
Thanks and Regards,
Rishi Yadav

On Fri, Apr 26, 2013 at 7:36 AM, < [EMAIL PROTECTED]
<javascript:parent.wgMail.openComposeWindow('[EMAIL PROTECTED]')>
> wrote:
When I submit a simple "Hello World" M/R job like WordCount it takes
less than 5 seconds. The texts show numerous methods for monitoring M/R
jobs as they are happening but I have yet to see any that show
statistics about a job after it has completed. Obviously simple jobs
that take a short amount of time don't allow time to fire up any web
mage or monitoring tool to see how it progresses through the JobTracker
and TaskTracker as well as which node it is processed on. Any
suggestions on how could see this kind of data *after* a job has
completed?
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB