Kafka, mail # user - heterogenous kafka cluster? - 2013-05-17, 21:30
Solr & Elasticsearch trainings in New York & San Fransisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Plain View
Copy link to this message
-
heterogenous kafka cluster?
Hi,

I'm wondering if there's a good way to have a heterogenous kafka cluster
(specifically, if we have nodes with different sized disks).  So, we might
want a larger node to receive more messages than a smaller node, etc.

I expect there's something we can do with using a partitioner that has
specific knowledge about the hosts in the cluster, but this feels messy, to
have this config on every producer client....

Thoughts?

Jason

 
+
Neha Narkhede 2013-05-17, 21:35
+
Jason Rosenberg 2013-05-17, 21:48
+
Chris Riccomini 2013-05-17, 21:50
+
Jason Rosenberg 2013-05-17, 22:26
+
Francis Dallaire 2013-05-17, 23:28
+
Jun Rao 2013-05-18, 03:38
+
Jason Rosenberg 2013-05-18, 06:28
+
Neha Narkhede 2013-05-23, 21:31
+
Maxime Brugidou 2013-05-23, 21:37
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB