I am using Kafka 0.7.2 I have a consumer that tries to fetch messages from several partitions on the same broker (and topic). The consumers issues a fetch request per partition, if there are messages to read, it fetches the first one and goes to the next partition to fetch another message and so on (in a loop). When there are not messages in a partition, the consumer will issue another fetch request on the next cycle etc. I noticed that starting with the 2nd fetch request, response time becomes unacceptable, i.e. reading back the response from the broker takes ~0.04 second (while it took ~0.0006 sec on the first time). This behavior is consistent over different runs.
On Tue, Jan 29, 2013 at 6:31 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext