Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Consumer resetting if zookeeper folder deleted


Copy link to this message
-
Consumer resetting if zookeeper folder deleted
Hi,

I observed that if zookeeper folder is deleted, consumer is trying to read
the messages it read in previous runs. And there are lots of exceptions
seen on zookeeper console as well::

java.nio.channels.CancelledKeyException
    at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55)
    at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:59)
    at
org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:418)
    at
org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1509)
    at
org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:171)
    at
org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:135)
[2012-05-07 15:57:35,569] ERROR Unexpected Exception:
(org.apache.zookeeper.server.NIOServerCnxn)
Is it an expected behaviour? Is zookeeper directory need to be protected to
avoid consumer falling off on offsets?

Thanks,
Navneet Sharma