I'm new to Kafka. I was wondering if it's possible to increase the no. of partitions of a topic during runtime(programmatically). I could see that there're command line tools to achieve this. If I do not have any other option, I was thinking of solving this by starting with excess no. of partitions and adding the logic to Partitioner class to utilize only a few partitions, initially. Later when the load goes up, by changing some hot property, producer can be re-configured to push to additional partitions. Is this a right way to do this? Please share if you've any ideas.
Re: Increasing the no. of partitions during runtime(programmatically)
What's your use case? How frequent do you expect to increase # partitions?
Jun On Mon, Mar 31, 2014 at 3:27 PM, Kiran Nagasubramanian <[EMAIL PROTECTED]>wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext