Re: only one ProducerSendThread thread when running with multiple brokers (kafka 0.8)
In 0.7, we have 1 producer send thread per broker. This is changed in 0.8,
where there is only 1 producer send thread per producer. If a producer
needs to send messages to multiple brokers, the send thread will do that
serially, which will reduce the throughput. We plan to improve that in 0.9
through client rewrites. For now, you can improve the throughput by either
using a larger batch size or using more producer instances.
As for degraded performance with more partitions, are you specifying a key
for each message?
On Wed, Jan 1, 2014 at 4:17 AM, yosi botzer <[EMAIL PROTECTED]> wrote: