Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Please help find the reason behind performance test results.


Copy link to this message
-
Re: Please help find the reason behind performance test results.
Are these for Kafka 08?

For #2 above, when you say high network I/O, do you mean number of packets
transferred or size in bytes transferred?

Thanks,
Neha
On Mon, Oct 21, 2013 at 12:01 PM, Lu Xuechao <[EMAIL PROTECTED]> wrote:

> Hi,
>
> We observed below correlation between kafka configuration and performance
> data:
>
> 1. producer insertion rate drops as compression enabled, especially gzip;
> 2. when the producer batch size is below 200, we got high CPU/network IO on
> brokers, got high network IO on producers/consumers;
>
> What's the reasons behind?
>
> thanks.
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB