Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Running Kafka in local test mode


Copy link to this message
-
Running Kafka in local test mode
Hi all,

I'm trying to run Kakfa in a minimal local test environment, but having issues gracefully shutting down.

I can start up ZooKeeper/Kafka, and it's running fine.

But when I try to shut it all down, I'm having trouble cleanly terminating the consumers.

I think the issue is that they're blocking on ConsumerIterator.makeNext(), which doesn't seem to be paying attention to being interrupted.

So then I proceed with cleaning up everything else, and shutting down the Kafka broker.

Which in turn triggers a kafka.consumer.ConsumerTimeoutException from the pending hasNext() call in my consumer Runnable.

What's the clean way to set up/tear down a ZooKeeper/Kafka setup that's being used indirectly by the test of another project?

Thanks!

-- Ken

--------------------------
Ken Krugler
http://www.scaleunlimited.com
custom big data solutions & training
Hadoop, Cascading, Mahout & Solr
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB