Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - Limit on number of Kafka Topic


+
Suyog Rao 2013-03-27, 06:52
Copy link to this message
-
Re: Limit on number of Kafka Topic
Jun Rao 2013-03-27, 15:33
At LinkedIn, our largest cluster has more than 2K topics. 5K topics should
be fine.

Thanks,

Jun

On Tue, Mar 26, 2013 at 11:52 PM, Suyog Rao <[EMAIL PROTECTED]> wrote:

> Hello,
>
> Wanted to check if there is any known limit on the # of topics in a Kafka
> cluster? I wanted to design a system which has say 5k topics and
> multi-threaded consumers reading messages from these topics. Does anyone
> have experience with such large topic size? I see in Kafka's page a test
> for throughput w.r.t. to topic size, but the max topic size is 50.
>
> Thanks
>

 
+
Jason Huang 2013-03-27, 15:37
+
Jun Rao 2013-03-27, 16:14
+
Matthew Rathbone 2013-03-27, 16:49