Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Large number of partitions


Copy link to this message
-
Re: Large number of partitions
This should be fine. For details, see
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowdoIchoosethenumberofpartitionsforatopic
?

Thanks,

Jun
On Tue, Dec 31, 2013 at 1:43 PM, Tom Amon <[EMAIL PROTECTED]> wrote:

> I'm looking to create a topic with about 1400 partitions to allow a high
> degree of parallel processing. We have 5 brokers so that would be 280
> partitions per box. Has anyone done something with this number of
> partitions before?
>
> Thanks.
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB