Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Log file parsing


Copy link to this message
-
RE: Log file parsing
Raj,
Thank you! This is perfect.
I was about to learn Perl so I could write a similar program.  I don't think awk or sed would cut it.
Now I don't have to and I can get on to my analysis right away.

Hank Cohen

From: Raj Vishwanathan [mailto:[EMAIL PROTECTED]]
Sent: Friday, August 17, 2012 3:34 PM
To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Subject: Re: Log file parsing

if you want to parse job log files, you can take a look at

https://github.com/rajvish/hadoop-summary

Raj

________________________________
From: Stan Rosenberg <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Sent: Friday, August 17, 2012 9:59 AM
Subject: Re: Log file parsing

org.apache.hadoop.mapred.DefaultJobHistoryParser is a good place to start.

On Fri, Aug 17, 2012 at 12:29 AM, Hank Cohen <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
> Are there any utilities available to help parse jobtracker log files?
>
>
>
> Hank Cohen
>
>
>
> [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
>
> www.altior.com<http://www.altior.com>
>
>
>
>
>
>