Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Log file parsing


Copy link to this message
-
RE: Log file parsing
Raj,
Thank you! This is perfect.
I was about to learn Perl so I could write a similar program.  I don't think awk or sed would cut it.
Now I don't have to and I can get on to my analysis right away.

Hank Cohen

From: Raj Vishwanathan [mailto:[EMAIL PROTECTED]]
Sent: Friday, August 17, 2012 3:34 PM
To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Subject: Re: Log file parsing

if you want to parse job log files, you can take a look at

https://github.com/rajvish/hadoop-summary

Raj

________________________________
From: Stan Rosenberg <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Sent: Friday, August 17, 2012 9:59 AM
Subject: Re: Log file parsing

org.apache.hadoop.mapred.DefaultJobHistoryParser is a good place to start.

On Fri, Aug 17, 2012 at 12:29 AM, Hank Cohen <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
> Are there any utilities available to help parse jobtracker log files?
>
>
>
> Hank Cohen
>
>
>
> [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
>
> www.altior.com<http://www.altior.com>
>
>
>
>
>
>

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB