Kafka, mail # user - Re: Kafka crashed after multiple topics were added - 2013-08-15, 23:08
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: Kafka crashed after multiple topics were added
The tradeoff is there:
Pro: more partitions means more consumer parallelism. The total
threads/processes across all consumer machines can't exceed the consumer
count.
Con: more partitions mean more file descriptors and hence smaller writes to
each file (so more random io).

Our setting is fairly random. The ideal number would be the smallest number
that satisfies your forceable need for consumer parallelism.

-Jay
On Thu, Aug 15, 2013 at 3:41 PM, Vadim Keylis <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB