Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: Multidata center support


Copy link to this message
-
Re: Multidata center support
The only problem i guess hadoop wont be able to duplicate data from one
data center to another but i guess i can identify data nodes or namenodes
from another data center correct me if i am wrong
On Sat, Aug 31, 2013 at 7:00 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> lets say that
>
> you have some machines in europe and some  in US I think you just need the
> ips and configure them in your cluster set up
> it will work...
>
>
> On Sat, Aug 31, 2013 at 7:52 AM, Jun Ping Du <[EMAIL PROTECTED]> wrote:
>
>> Hi,
>>     Although you can set datacenter layer on your network topology, it is
>> never enabled in hadoop as lacking of replica placement and task scheduling
>> support. There are some work to add layers other than rack and node under
>> HADOOP-8848 but may not suit for your case. Agree with Adam that a cluster
>> spanning multiple data centers seems not make sense even for DR case. Do
>> you have other cases to do such a deployment?
>>
>> Thanks,
>>
>> Junping
>>
>> ------------------------------
>> *From: *"Adam Muise" <[EMAIL PROTECTED]>
>> *To: *[EMAIL PROTECTED]
>> *Sent: *Friday, August 30, 2013 6:26:54 PM
>> *Subject: *Re: Multidata center support
>>
>>
>> Nothing has changed. DR best practice is still one (or more) clusters per
>> site and replication is handled via distributed copy or some variation of
>> it. A cluster spanning multiple data centers is a poor idea right now.
>>
>>
>>
>>
>> On Fri, Aug 30, 2013 at 12:35 AM, Rahul Bhattacharjee <
>> [EMAIL PROTECTED]> wrote:
>>
>>> My take on this.
>>>
>>> Why hadoop has to know about data center thing. I think it can be
>>> installed across multiple data centers , however topology configuration
>>> would be required to tell which node belongs to which data center and
>>> switch for block placement.
>>>
>>> Thanks,
>>> Rahul
>>>
>>>
>>> On Fri, Aug 30, 2013 at 12:42 AM, Baskar Duraikannu <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> We have a need to setup hadoop across data centers.  Does hadoop
>>>> support multi data center configuration? I searched through archives and
>>>> have found that hadoop did not support multi data center configuration some
>>>> time back. Just wanted to see whether situation has changed.
>>>>
>>>> Please help.
>>>>
>>>
>>>
>>
>>
>> --
>> *
>> *
>> *
>> *
>> *Adam Muise*
>> Solution Engineer
>> *Hortonworks*
>> [EMAIL PROTECTED]
>> 416-417-4037
>>
>> Hortonworks - Develops, Distributes and Supports Enterprise Apache Hadoop.<http://hortonworks.com/>
>>
>> Hortonworks Virtual Sandbox <http://hortonworks.com/sandbox>
>>
>> Hadoop: Disruptive Possibilities by Jeff Needham<http://hortonworks.com/resources/?did=72&cat=1>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>>
>>
>