Kafka, mail # user - Re: About speed contorl in Kafka - 2013-12-12, 17:20
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
Re: About speed contorl in Kafka
Sounds to me your consumer performance is the problem, not the producer.
So either make your consumers faster or make them consume but drop messages
to keep up with the producer speed.
This also gives you some means of keeping track of how many messages are
lost, why, and when.

And just for reference; the Kafka broker->consumer throughput is far higher
than the producer->broker throughput.
2013/12/12 xingcan <[EMAIL PROTECTED]>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB