If the data is compressed, the broker has to recompress the messages in
order to assign offsets. So, there is some CPU overhead. However, it
shouldn't be too high. How high of the CPU load did you observe?
On Mon, Oct 21, 2013 at 12:01 PM, Lu Xuechao <[EMAIL PROTECTED]> wrote:
> We observed below correlation between kafka configuration and performance
> 1. producer insertion rate drops as compression enabled, especially gzip;
> 2. when the producer batch size is below 200, we got high CPU/network IO on
> brokers, got high network IO on producers/consumers;
> What's the reasons behind?