Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # dev >> [jira] [Commented] (KAFKA-1190) create a draw performance graph script

Copy link to this message
[jira] [Commented] (KAFKA-1190) create a draw performance graph script

    [ https://issues.apache.org/jira/browse/KAFKA-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13864935#comment-13864935 ]

Joel Koshy commented on KAFKA-1190:

This is useful but do we want to check-in very specific scripts as opposed to an external contrib location or even one of the wikis? csv is a general-enough raw format that people can read to generate graphs/reports using R/gnuplot/matlab/excel/whatever number crunchers they like.

> create a draw performance graph script
> --------------------------------------
>                 Key: KAFKA-1190
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1190
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Joe Stein
>             Fix For: 0.8.1
>         Attachments: KAFKA-1190.patch
> This will be an R script to draw relevant graphs given a bunch of csv files from the above tools. The output of this script will be a bunch of png files that can be combined with some html to act as a perf report.
> Here are the graphs that would be good to see:
> * Latency histogram for producer
> * MB/sec and messages/sec produced
> * MB/sec and messages/sec consumed
> * Flush time
> * Errors (should not be any)
> * Consumer cache hit ratio (both the bytes and count, specifically 1
>   #physical_reads / #requests and 1 - physical_bytes_read / bytes_read)
> * Write merge ratio (num_physical_writes/num_produce_requests and     avg_request_size/avg_physical_write_size)
> CPU, network, io, etc

This message was sent by Atlassian JIRA