Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Tools for extracting data from hadoop logs

Copy link to this message
Re: Tools for extracting data from hadoop logs
Hi bharath Apache Flume is there and also if you want to take a look Scribe
from Facebook is also there then there are other log aggregation tool too.

On Tue, Oct 30, 2012 at 7:18 AM, bharath vissapragada <

> Hi list,
> Are the any tools for parsing and extracting data from Hadoop's Job Logs?
> I want to do stuff like ..
> 1. Getting run time of each map/reduce task
> 2. Total map/reduce tasks ran on a particular node in that job  and some
> similar stuff
> Any suggestions?
> Thanks