Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Access Hadoop Counters

Copy link to this message
Re: Access Hadoop Counters

Are you attempting to modify MR sources? JobInProgress is a system
class, not to be used by users directly. If you seek MR project-side
development help, its better to reach the mapreduce-dev@ lists

That said, if you want the file/hdfs bytes counters, you can access
them via the RunningJob or Job APIs directly (just give the group and
counter names).

On Tue, Oct 30, 2012 at 9:19 AM, Nan Zhu <[EMAIL PROTECTED]> wrote:
> Hi, all
> I noticed that in FileInputFormat and FileOutputFormat classes, there are
> counters(Counter's name?) for input and output data size,
> my question is that given a JobInProgress object, e.g. jip, after I get the
> corresponding object by
> FileInputFormat fif = (FileInputFormat) jip.getConf().getInputFormat();
> FileOutputFormat fof = (FileOutputFormat)
> jip.getConf().getOutputputFormat();
> How can I access the values of the counters?
> Best,
> --
> Nan Zhu
> School of Computer Science,
> McGill University

Harsh J