Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> QueueFullException


Copy link to this message
-
Re: QueueFullException
Paul,

This behavior is unexpected and the code suggests QueueFullException
is thrown back to the caller. I would take a thread dump when the
producer is blocked to see what's causing the blocking behavior.

Thanks,
Neha

On Thu, Nov 15, 2012 at 12:53 PM, Paul Mackles <[EMAIL PROTECTED]> wrote:
> I am tinkering with the java async producer from kafka 7.2 and I am trying to write a client that will never block when sending messages to a kafka broker (dropping them would be better than blocking). I can send messages at a rate that is fast enough to trigger a QueueFullException but the exception never propagates up to my client code. In other words, I see the stack trace and the error message on the console but the call to Producer.send() that triggered the exception just hangs indefinitely. In this setup, queue.enqueueTimeout.ms=0. I get the same result when I set queue.enqueueTimeout.ms to a very low number positive number. Is this the intended behavior? Is there another way to guarantee your client can never block? If I had to guess, maybe the exception is happening in a background thread of some kind and that is why I never see it? My knowledge of scala is extremely limited. Here is the code I am using:
>
> https://gist.github.com/4081183
>
> Thanks,
> Paul
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB