Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> heterogenous kafka cluster?

Copy link to this message
Re: heterogenous kafka cluster?
That does seem a little hacky. But I'm trying to understand the requirement
behind having to deploy heterogeneous hardware. What are you trying to
achieve or optimize?

On Fri, May 17, 2013 at 2:29 PM, Jason Rosenberg <[EMAIL PROTECTED]> wrote:

> Hi,
> I'm wondering if there's a good way to have a heterogenous kafka cluster
> (specifically, if we have nodes with different sized disks).  So, we might
> want a larger node to receive more messages than a smaller node, etc.
> I expect there's something we can do with using a partitioner that has
> specific knowledge about the hosts in the cluster, but this feels messy, to
> have this config on every producer client....
> Thoughts?
> Jason