Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Complex multi-datacenter setups

Copy link to this message
Re: Complex multi-datacenter setups
Our plan is keep the agg cluster in a few, but not all DCs.


On Fri, Jul 12, 2013 at 9:30 AM, Maxime Petazzoni <[EMAIL PROTECTED]
> wrote:

> * Jun Rao <[EMAIL PROTECTED]> [2013-07-11 21:10:46]:
> > We we have at LinkedIn is an extra aggregate cluster per data center. We
> > use mirror maker to copy data from the local cluster in each of the data
> > centers to the aggregate one.
> Do you mean you have an aggregate cluster in each datacenter that gets
> all the data from all the other datacenters? And you have that setup in
> all your datacenters?
> Don't you end up moving a lot of data around for nothing? I'd like to
> hear more about your setup, if that's something you are a liberty to
> share.
> TIA,
> /Max
> --
> Maxime Petazzoni
> Sr. Platform Engineer
> m 408.310.0595
> www.turn.com