Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Analysing Hadoop log files offline.


Copy link to this message
-
Analysing Hadoop log files offline.
Please take a look at 

https://github.com/rajvish/hadoop-summary 
These scripts enable you to take a hadoop job logs and can provide both a summary information or detailed task information.
I have tested it on both 0.20.* and 1.0.

The output is a CSV file that can be analysed using  other programs such as excel. 

I would love to get feedback.

-regards

Raj
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB