You have to determine whether the bottleneck is in the consumer or the
To improve the performance of the latter, you can increase the # of total
consumer streams. # streams is capped by total # partitions. So, you may
need to increase the # of partitions.
To improve the performance of the latter, you can (a) increase the batch
size in async mode and/or (b) run more instances of producers.
Metadata refresh interval is configurable. It's mainly for the producer to
pick up newly available partitions.
On Thu, Aug 22, 2013 at 1:44 PM, Rajasekar Elango <[EMAIL PROTECTED]>wrote: