Kafka, mail # dev - Re: kafka 0.8 producer throughput - 2013-01-09, 05:41
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Plain View
Copy link to this message
Re: kafka 0.8 producer throughput
The 50MB/s number is for 0.7. We haven't carefully measured the performance
in 0.8 yet. We do expect the throughput that a single producer can drive in
0.8 to be less. This is because the 0.8 producer needs to wait for an RPC
response from the broker while in 0.7, there is no ack for the producer.
Nevertheless, 2MB/s seems low. Could you try increasing flush interval to
sth bigger, like 20000?



On Tue, Jan 8, 2013 at 8:32 PM, Jun Guo -X (jungu - CIIC at Cisco) <
S Ahmed 2013-01-09, 14:21
Jun Rao 2013-01-09, 16:25
Jay Kreps 2013-01-09, 16:31
Jun Guo -X 2013-01-09, 04:34
Jay Kreps 2013-01-25, 17:42
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB