Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> load-balancing consumers question


Copy link to this message
-
Re: load-balancing consumers question
Hello Michal,

This FAQ entry may help you understanding the rebalance logic:

https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-CanIpredicttheresultsoftheconsumerrebabalance%3F

In a word, since we use a deterministic range partition in rebalance,
unevenly or customized partition assignment is not possible for now, but we
are looking into supporting customized partition assignment in post 0.8:

https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite

Guozhang
On Thu, Aug 22, 2013 at 11:00 AM, Michal Haris
<[EMAIL PROTECTED]>wrote:

> Hi, is it possible or has anybody tried/needed to balance partitions
> between consumers unevenly or based on some custom function ? Ideally with
> Kafka 0.7
>
> Michal Haris
>

--
-- Guozhang