Kafka is designed to have of the order of few thousands of partitions
roughly less than 10,000. And the main bottleneck is zookeeper. A better
way to design such a system is to have fewer partitions and use keyed
messages to distribute the data over a fixed set of partitions.
On Oct 5, 2013 8:19 PM, "Ravindranath Akila" <[EMAIL PROTECTED]>