Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> load-balancing consumers question


Copy link to this message
-
Re: load-balancing consumers question
Thanks Guozhang.
On 22 August 2013 19:11, Guozhang Wang <[EMAIL PROTECTED]> wrote:

> Hello Michal,
>
> This FAQ entry may help you understanding the rebalance logic:
>
>
> https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-CanIpredicttheresultsoftheconsumerrebabalance%3F
>
> In a word, since we use a deterministic range partition in rebalance,
> unevenly or customized partition assignment is not possible for now, but we
> are looking into supporting customized partition assignment in post 0.8:
>
> https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite
>
> Guozhang
>
>
> On Thu, Aug 22, 2013 at 11:00 AM, Michal Haris
> <[EMAIL PROTECTED]>wrote:
>
> > Hi, is it possible or has anybody tried/needed to balance partitions
> > between consumers unevenly or based on some custom function ? Ideally
> with
> > Kafka 0.7
> >
> > Michal Haris
> >
>
>
>
> --
> -- Guozhang
>

--
Michal Haris
Technical Architect

www.visualdna.com | t: +44 (0) 207 734 7033

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB