I ran command to create 300 topics sequentially. Kafka create topic script return with topic created successfully message. However running kafka-list-topics.sh script showed to me that no leaders been selected and no servers listed in ISR. First inspection of the logs showed no obvious signs of the problem. After restarting kafka. I did a few restarts of kafka service and its now showing that most partitions have brokers.
Second issue is with delete partition script. I attempted to delete topics to begin fresh start. Even those script says it deleted partition successfully, I still see no leader found exception.
Any suggestions on whats going on and how to avoid in the future?
As part of topic creation, the controller broker has to elect leader for each of the topics and this involves a few writes to zookeeper. So it might take several seconds to complete leader election for 300 topics and that time would increase if you have many partitions per topic.
Which delete partition script are you referring to? We don't have a delete topic feature in Kafka yet. So you can only create more partitions, but not delete them.
Thanks, Neha On Thu, Aug 22, 2013 at 10:01 AM, Vadim Keylis <[EMAIL PROTECTED]>wrote:
Sorry Jun. Somehow logs from that particular event got wiped out. On Thu, Aug 22, 2013 at 8:59 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext