Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Collecting error messages from Mappers

Terry Healy 2012-10-08, 14:13
Copy link to this message
Re: Collecting error messages from Mappers
If it is only to get a parse overview of the run you can use counters. But
you shouldn't overuse them.
You can for example count exceptions by type (but by message is not a good
approach unless you are sure that the message is constant.)



On Mon, Oct 8, 2012 at 4:13 PM, Terry Healy <[EMAIL PROTECTED]> wrote:

> Hi-
> Is there a simple way for error output / debug information generated by
> a Mapper to be collected in one place for a given M/R job run? I guess
> what I'm hoping for is sort of the reverse of a Distributed Cache function.
> Can anyone suggest an approach?
> Thanks,
> Terry

Bertrand Dechoux