Kafka, mail # user - Limit on number of Kafka Topic - 2013-03-27, 06:52
 Search Hadoop and all its subprojects:

Switch to Plain View
Copy link to this message
-
Limit on number of Kafka Topic
Hello,

Wanted to check if there is any known limit on the # of topics in a Kafka
cluster? I wanted to design a system which has say 5k topics and
multi-threaded consumers reading messages from these topics. Does anyone
have experience with such large topic size? I see in Kafka's page a test
for throughput w.r.t. to topic size, but the max topic size is 50.

Thanks

 
+
Jun Rao 2013-03-27, 15:33
+
Jason Huang 2013-03-27, 15:37
+
Jun Rao 2013-03-27, 16:14
+
Matthew Rathbone 2013-03-27, 16:49
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB