Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Re: heterogenous kafka cluster?


+
Jason Rosenberg 2013-05-17, 22:26
+
Francis Dallaire 2013-05-17, 23:28
Copy link to this message
-
heterogenous kafka cluster?
Hi,

I'm wondering if there's a good way to have a heterogenous kafka cluster
(specifically, if we have nodes with different sized disks).  So, we might
want a larger node to receive more messages than a smaller node, etc.

I expect there's something we can do with using a partitioner that has
specific knowledge about the hosts in the cluster, but this feels messy, to
have this config on every producer client....

Thoughts?

Jason

 
+
Neha Narkhede 2013-05-17, 21:35
+
Jason Rosenberg 2013-05-17, 21:48
+
Jun Rao 2013-05-18, 03:38
+
Jason Rosenberg 2013-05-18, 06:28
+
Neha Narkhede 2013-05-23, 21:31
+
Maxime Brugidou 2013-05-23, 21:37
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB