Search Hadoop and all its sub project:

Switch to Threaded View
Subject: Re: Recommendation for number of brokers on kafka(0.7.2) hosts
1) Will setting 4 brokers per host with different ports and different log
data directories be beneficial to use all the available space?
2) Will there be any disadvantage using multiple brokers on same host?

It is recommended that you do not deploy multiple brokers on the same box
since that will not lead to optimal page cache usage, which will affect IO

3) If partition count is set to 2 per topic. Having multiple brokers on
each machine , multiply the partition count per machine? i.e with 4 brokers
per machine on 5 machines will generate 2*4*5 = 40 partitions per topic?


4) Is there a way to use all the directories from a single broker?

Kafka 0.8 supports specifying multiple log directories through the log.dirs

On Tue, Oct 1, 2013 at 1:17 PM, rk vishu <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB