Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Complex multi-datacenter setups


Copy link to this message
-
Re: Complex multi-datacenter setups
Our plan is keep the agg cluster in a few, but not all DCs.

Thanks,

Jun
On Fri, Jul 12, 2013 at 9:30 AM, Maxime Petazzoni <[EMAIL PROTECTED]
> wrote:

> * Jun Rao <[EMAIL PROTECTED]> [2013-07-11 21:10:46]:
>
> > We we have at LinkedIn is an extra aggregate cluster per data center. We
> > use mirror maker to copy data from the local cluster in each of the data
> > centers to the aggregate one.
>
> Do you mean you have an aggregate cluster in each datacenter that gets
> all the data from all the other datacenters? And you have that setup in
> all your datacenters?
>
> Don't you end up moving a lot of data around for nothing? I'd like to
> hear more about your setup, if that's something you are a liberty to
> share.
>
> TIA,
> /Max
> --
> Maxime Petazzoni
> Sr. Platform Engineer
> m 408.310.0595
> www.turn.com
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB