Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Leader doesn't get assigned for new topics


Copy link to this message
-
Leader doesn't get assigned for new topics
We are seeing a problem that we we try to send messages to new topic it
fails kafka.common.LeaderNotAvailableException. But usually this problem
will be transient and if we re-send messages to same topic will work. But
now we tried rending message to same topic several time, but still fails
with same error:

In the server log I see ] Auto creation of topic test-sjl2 with 8
partitions and replication factor 3 is successful!. But listTopics command
shows leader "none" like below:

topic: test-sjl2        partition: 0    leader: none    replicas: 2,4,3 isr:
topic: test-sjl2        partition: 1    leader: none    replicas: 3,2,4 isr:
topic: test-sjl2        partition: 2    leader: none    replicas: 4,3,2 isr:
topic: test-sjl2        partition: 3    leader: none    replicas: 2,3,4 isr:
topic: test-sjl2        partition: 4    leader: none    replicas: 3,4,2 isr:
topic: test-sjl2        partition: 5    leader: none    replicas: 4,2,3 isr:
topic: test-sjl2        partition: 6    leader: none    replicas: 2,4,3 isr:
topic: test-sjl2        partition: 7    leader: none    replicas: 3,2,4 isr:

I also see following NotLeaderForPatritionExcetion and ZookeeperExcetion in
logs

kafka.common.NotLeaderForPartitionException
        at sun.reflect.GeneratedConstructorAccessor19.newInstance(Unknown
Source)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at java.lang.Class.newInstance0(Class.java:355)
        at java.lang.Class.newInstance(Class.java:308)
        at kafka.common.ErrorMapping$.exceptionFor(ErrorMapping.scala:70)
        at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$4$$anonfun$apply$5.apply(AbstractFetcherThread.scala:158)
        at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$4$$anonfun$apply$5.apply(AbstractFetcherThread.scala:158)
        at kafka.utils.Logging$class.warn(Logging.scala:88)
        at kafka.utils.ShutdownableThread.warn(ShutdownableThread.scala:23)
        at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$4.apply(AbstractFetcherThread.scala:157)
        at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$4.apply(AbstractFetcherThread.scala:113)
        at
scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:178)
        at
scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:347)
        at
kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:113)
        at
kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:89)
        at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:51)
2013-09-12 23:54:10,838 [kafka-request-handler-2] ERROR
(kafka.utils.ZkUtils$)  - Conditional update of path
/brokers/topics/FunnelProto/partitions/4/state with data {
"controller_epoch":3, "isr":[ 2, 5 ], "leader":2, "leader_epoch":2,
"version":1 } and expected version 14 failed due to
org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode =
BadVersion for /brokers/topics/FunnelProto/partitions/4/state
2013-09-12 23:54:10,838 [kafka-request-handler-2] ERROR
(kafka.utils.ZkUtils$)  - Conditional update of path
/brokers/topics/FunnelProto/partitions/4/state with data {
"controller_epoch":3, "isr":[ 2, 5 ], "leader":2, "leader_epoch":2,
"version":1 } and expected version 14 failed due to
org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode =
BadVersion for /brokers/topics/FunnelProto/partitions/4/state
Any clues on what could be problem.. ?

Any for your help.

--
Thanks,
Raja.

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB