Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Analysing Hadoop log files offline.


Copy link to this message
-
Analysing Hadoop log files offline.
Raj Vishwanathan 2012-04-05, 18:24
Please take a look at 

https://github.com/rajvish/hadoop-summary 
These scripts enable you to take a hadoop job logs and can provide both a summary information or detailed task information.
I have tested it on both 0.20.* and 1.0.

The output is a CSV file that can be analysed using  other programs such as excel. 

I would love to get feedback.

-regards

Raj