Kafka, mail # user - Re: Kafka and Zookeeper node removal from two nodes Kafka cluster - 2013-10-16, 04:26
 Search Hadoop and all its subprojects:

Switch to Plain View
Monika Garg 2013-10-15, 10:46
Jun Rao 2013-10-15, 15:48
Monika Garg 2013-10-15, 17:12
Steve Morin 2013-10-15, 17:19
Joel Koshy 2013-10-15, 20:26
Jason Rosenberg 2013-10-15, 20:47
Joel Koshy 2013-10-15, 23:16
Jun Rao 2013-10-16, 03:58
Copy link to this message
Re: Kafka and Zookeeper node removal from two nodes Kafka cluster
Yeah, so it would seem a work around could be to defer full replica
assignment until adequate brokers are available, but in the meantime, allow
topic creation to proceed.

With respect to Joel's point around the possibility for imbalanced
partition assignment if not all replicas are available, this really just
points to the long-term need to have partition rebalancing (and I'd argue
this should be dynamic, and support heterogenous server nodes, where some
can have more capacity than others).  Ultimately, if we want to support
easy horizontal scalability, then it should be possible to quickly add new
nodes to a cluster, and have them in short-order start taking up equal
load, etc.
On Tue, Oct 15, 2013 at 8:57 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB