Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Tools for extracting data from hadoop logs


Copy link to this message
-
Re: Tools for extracting data from hadoop logs
anand sharma 2012-10-30, 02:23
Hi bharath Apache Flume is there and also if you want to take a look Scribe
from Facebook is also there then there are other log aggregation tool too.

On Tue, Oct 30, 2012 at 7:18 AM, bharath vissapragada <
[EMAIL PROTECTED]> wrote:

> Hi list,
>
> Are the any tools for parsing and extracting data from Hadoop's Job Logs?
> I want to do stuff like ..
>
> 1. Getting run time of each map/reduce task
> 2. Total map/reduce tasks ran on a particular node in that job  and some
> similar stuff
>
> Any suggestions?
>
> Thanks
>