-Re: Getting the configuration object for a MapReduce job from the DataNode
Ravi Prakash 2012-10-22, 06:00
Please use [EMAIL PROTECTED] for user-related questions
Which version of Hadoop are you using? Where do you want the object? In a map/reduce task? For the currently executing job or for a different job?
In 0.23, you can use the RM webservices. https://issues.apache.org/jira/browse/MAPREDUCE-2863 . I'm sorry I wasn't able to find a hosted version of the documentation, but here's the source which ought to be built easily : http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/HistoryServerRest.apt.vm?revision=1399289&view=markup . If you'd like the formatted HTML, just build the source using mvn site
From: Adrian Suarez <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Thursday, October 18, 2012 4:23 PM
Subject: Getting the configuration object for a MapReduce job from the DataNode
What's the best way to get the configuration object for a job, assuming
that I only know the job ID? I remember seeing some method or constructor
that creates a configuration object from an XML file, and I know that the
job's configuration file gets saved in the logs directory, but I'm
wondering if there is a more correct way of doing this that doesn't involve
assuming the existence of an XML file with a particular name.