Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # dev >> [jira] [Commented] (KAFKA-1190) create a draw performance graph script


Copy link to this message
-
[jira] [Commented] (KAFKA-1190) create a draw performance graph script

    [ https://issues.apache.org/jira/browse/KAFKA-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13864935#comment-13864935 ]

Joel Koshy commented on KAFKA-1190:
-----------------------------------

This is useful but do we want to check-in very specific scripts as opposed to an external contrib location or even one of the wikis? csv is a general-enough raw format that people can read to generate graphs/reports using R/gnuplot/matlab/excel/whatever number crunchers they like.

> create a draw performance graph script
> --------------------------------------
>
>                 Key: KAFKA-1190
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1190
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Joe Stein
>             Fix For: 0.8.1
>
>         Attachments: KAFKA-1190.patch
>
>
> This will be an R script to draw relevant graphs given a bunch of csv files from the above tools. The output of this script will be a bunch of png files that can be combined with some html to act as a perf report.
> Here are the graphs that would be good to see:
> * Latency histogram for producer
> * MB/sec and messages/sec produced
> * MB/sec and messages/sec consumed
> * Flush time
> * Errors (should not be any)
> * Consumer cache hit ratio (both the bytes and count, specifically 1
>   #physical_reads / #requests and 1 - physical_bytes_read / bytes_read)
> * Write merge ratio (num_physical_writes/num_produce_requests and     avg_request_size/avg_physical_write_size)
> CPU, network, io, etc

--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB