I went through the performance page where it can reach a speed of 50MBps.
I think that number is true for 07, not 08. If you want higher producer
throughout in 08, you can set request . required.acks=0. Note that it means
that the producer does not receive server side acknowledgements if you use
that config. We plan to address the 08 throughput issue in 09.
On Nov 18, 2013 11:50 PM, "Abhinav Anand" <[EMAIL PROTECTED]> wrote:
> I am using kafka producer and broker for a production setup. The expected
> producer output is 20MBps but I am only getting max of 8MBps. I have
> verified that we are losing packets by directly connecting to the data
> source through TCP though the metrics is not reflecting any loss.
> I went through the performance page where it can reach a speed of 50MBps.
> Please look at the config and suggest if there is some configuration
> improvement i can do.
> *** *Message Size* ***
> Message size = 3KB
> ***** Producer Config ****
> producer.type = async
> queue.buffering.max.ms = 100
> queue.buffering.max.messages = 4000
> request.timeout.ms = 30000
> batch.num.messages = 200
> **** Broker Config* ***
> Abhinav Anand