Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - producer queue size

Jamie Wang 2012-11-26, 22:28
Copy link to this message
Re: producer queue size
Joel Koshy 2012-11-27, 00:06
To use async, set producer.type to async ; The default queue size is 10000;
and the default batch size is 200.
On Mon, Nov 26, 2012 at 2:28 PM, Jamie Wang <[EMAIL PROTECTED]> wrote:

> Hi, I am running the console demo comes with 0.7.2  in getting started
> guide. All is working fine. Then I use stdio redirect a file of 30K lines
> of messages into the producer and I received  an error "ERROR Event queue
> is full of unsent messages, could not send event:..." and exception stack
> shows:
> Exception in thread "main" kafka.producer.async.QueueFullException: Event
> queue is full of unsent messages, could not send event:...
> Is there a way in the produce.properties to configure the size of producer
> queue?   I know the producer is running in synchronous mode. How do I solve
> this problem or my usage is totally wrong?
> Thanks
> Jamie
Neha Narkhede 2012-11-27, 00:40
Jay Kreps 2012-11-27, 01:02