Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: Getting the configuration object for a MapReduce job from the DataNode


Copy link to this message
-
Re: Getting the configuration object for a MapReduce job from the DataNode
Hi Adrian,

Please use [EMAIL PROTECTED] for user-related questions

Which version of Hadoop are you using? Where do you want the object? In a map/reduce task? For the currently executing job or for a different job?

In 0.23, you can use the RM webservices. https://issues.apache.org/jira/browse/MAPREDUCE-2863 . I'm sorry I wasn't able to find a hosted version of the documentation, but here's the source which ought to be built easily : http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/HistoryServerRest.apt.vm?revision=1399289&view=markup . If you'd like the formatted HTML, just build the source using mvn site
HTH
Ravi

________________________________
 From: Adrian Suarez <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Thursday, October 18, 2012 4:23 PM
Subject: Getting the configuration object for a MapReduce job from the DataNode
 
What's the best way to get the configuration object for a job, assuming
that I only know the job ID? I remember seeing some method or constructor
that creates a configuration object from an XML file, and I know that the
job's configuration file gets saved in the logs directory, but I'm
wondering if there is a more correct way of doing this that doesn't involve
assuming the existence of an XML file with a particular name.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB