Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Partition Balancing


+
Tom Amon 2013-09-16, 23:43
+
Joel Koshy 2013-09-17, 17:06
+
Tom Amon 2013-09-17, 21:26
Copy link to this message
-
Re: Partition Balancing
Hi Tom, that's right - see
http://kafka.apache.org/documentation.html#datacenters

Thanks,

Joel

On Tue, Sep 17, 2013 at 1:57 PM, Tom Amon <[EMAIL PROTECTED]> wrote:
> This means it's not recommended to spread a cluster of brokers over more
> than one data center? Are there specific timing or performance issues
> related to this?
>
>
>> Intra-cluster replication support is not recommended for an inter-DC set
> up. You can instead set up a mirror of a cluster in another DC.
>
>>
> https://cwiki.apache.org/confluence/display/KAFKA/Kafka+mirroring+%28MirrorMaker%29
>
>
>
>> Thanks,
>
>> Joel
>
>
>
>> On Mon, Sep 16, 2013 at 4:19 PM, Tom Amon <[EMAIL PROTECTED]> wrote:
>
>> > Is it possible to specify data center information to Kafka such that
>
>> > all replicas for a given partition are not in the same data center? We
>
>> > have a cluster that spans 2 data centers and I'd like to ensure that
>
>> > we're covered if we lose one of them.

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB