Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Re: Multidata center support


Copy link to this message
-
Re: Multidata center support
Visioner Sadak 2013-08-31, 13:30
lets say that

you have some machines in europe and some  in US I think you just need the
ips and configure them in your cluster set up
it will work...
On Sat, Aug 31, 2013 at 7:52 AM, Jun Ping Du <[EMAIL PROTECTED]> wrote:

> Hi,
>     Although you can set datacenter layer on your network topology, it is
> never enabled in hadoop as lacking of replica placement and task scheduling
> support. There are some work to add layers other than rack and node under
> HADOOP-8848 but may not suit for your case. Agree with Adam that a cluster
> spanning multiple data centers seems not make sense even for DR case. Do
> you have other cases to do such a deployment?
>
> Thanks,
>
> Junping
>
> ------------------------------
> *From: *"Adam Muise" <[EMAIL PROTECTED]>
> *To: *[EMAIL PROTECTED]
> *Sent: *Friday, August 30, 2013 6:26:54 PM
> *Subject: *Re: Multidata center support
>
>
> Nothing has changed. DR best practice is still one (or more) clusters per
> site and replication is handled via distributed copy or some variation of
> it. A cluster spanning multiple data centers is a poor idea right now.
>
>
>
>
> On Fri, Aug 30, 2013 at 12:35 AM, Rahul Bhattacharjee <
> [EMAIL PROTECTED]> wrote:
>
>> My take on this.
>>
>> Why hadoop has to know about data center thing. I think it can be
>> installed across multiple data centers , however topology configuration
>> would be required to tell which node belongs to which data center and
>> switch for block placement.
>>
>> Thanks,
>> Rahul
>>
>>
>> On Fri, Aug 30, 2013 at 12:42 AM, Baskar Duraikannu <
>> [EMAIL PROTECTED]> wrote:
>>
>>> We have a need to setup hadoop across data centers.  Does hadoop support
>>> multi data center configuration? I searched through archives and have found
>>> that hadoop did not support multi data center configuration some time back.
>>> Just wanted to see whether situation has changed.
>>>
>>> Please help.
>>>
>>
>>
>
>
> --
> *
> *
> *
> *
> *Adam Muise*
> Solution Engineer
> *Hortonworks*
> [EMAIL PROTECTED]
> 416-417-4037
>
> Hortonworks - Develops, Distributes and Supports Enterprise Apache Hadoop.<http://hortonworks.com/>
>
> Hortonworks Virtual Sandbox <http://hortonworks.com/sandbox>
>
> Hadoop: Disruptive Possibilities by Jeff Needham<http://hortonworks.com/resources/?did=72&cat=1>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
>