Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Mapreduce counters

Ophir Cohen 2011-05-18, 15:21
Copy link to this message
Re: Mapreduce counters
Hi Ophir,

That sounds like a useful feature, maybe file a jira?

I've never tried to save counters form the MR job into HBase, but you
could pull it from the file as you said or from the Job object after
waitForCompletion() returns by calling getCounters().


On Wed, May 18, 2011 at 8:21 AM, Ophir Cohen <[EMAIL PROTECTED]> wrote:
> Hi All,
> Currently MR job spilled his counters into file at the end of the run.
> Is there any built-in configuration/plug-in to make it store these counters
> into HBase as well?
> Sounds to me like a great feature!
> Does anybody did something similar?
> If you did, how did you do it? Run on directory and load it into HBase?
> Thanks,
> Ophir

Joseph Echeverria
Cloudera, Inc.
Ophir Cohen 2011-05-18, 17:36