Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> preferred leader election...


Copy link to this message
-
preferred leader election...
So, I'm running into the case where after issuing a rolling restart, with
controlled shutdown enabled, the last server restarted ends up without any
partitions that it's the leader of.  This is more pronounced of course if I
have only 2 servers in the cluster (during testing).  I presume it's kind
of a problem to have imbalance in the number of partitions each server is
leader of?  (Or maybe not such a big deal, since the servers still need to
forward messages between themselves anyway?).

So, I was looking at the 'preferred leader election' tool here:

https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools

Is there a way to programmatically invoke this.  I was thinking it make
sense to do periodically (e.g. once an hour), and also after a restart.
 But I'd like it to happen from within my app (which contains kafka),
rather than invoking an external tool.

Thanks,

Jason

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB