Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Re: Multidata center support


Copy link to this message
-
Re: Multidata center support
Visioner Sadak 2013-08-31, 18:50
What do you think friends I think hadoop clusters can run on multiple data
centers using FEDERATION
On Sat, Aug 31, 2013 at 8:39 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> The only problem i guess hadoop wont be able to duplicate data from one
> data center to another but i guess i can identify data nodes or namenodes
> from another data center correct me if i am wrong
>
>
> On Sat, Aug 31, 2013 at 7:00 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:
>
>> lets say that
>>
>> you have some machines in europe and some  in US I think you just need
>> the ips and configure them in your cluster set up
>> it will work...
>>
>>
>> On Sat, Aug 31, 2013 at 7:52 AM, Jun Ping Du <[EMAIL PROTECTED]> wrote:
>>
>>> Hi,
>>>     Although you can set datacenter layer on your network topology, it
>>> is never enabled in hadoop as lacking of replica placement and task
>>> scheduling support. There are some work to add layers other than rack and
>>> node under HADOOP-8848 but may not suit for your case. Agree with Adam that
>>> a cluster spanning multiple data centers seems not make sense even for DR
>>> case. Do you have other cases to do such a deployment?
>>>
>>> Thanks,
>>>
>>> Junping
>>>
>>> ------------------------------
>>> *From: *"Adam Muise" <[EMAIL PROTECTED]>
>>> *To: *[EMAIL PROTECTED]
>>> *Sent: *Friday, August 30, 2013 6:26:54 PM
>>> *Subject: *Re: Multidata center support
>>>
>>>
>>> Nothing has changed. DR best practice is still one (or more) clusters
>>> per site and replication is handled via distributed copy or some variation
>>> of it. A cluster spanning multiple data centers is a poor idea right now.
>>>
>>>
>>>
>>>
>>> On Fri, Aug 30, 2013 at 12:35 AM, Rahul Bhattacharjee <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> My take on this.
>>>>
>>>> Why hadoop has to know about data center thing. I think it can be
>>>> installed across multiple data centers , however topology configuration
>>>> would be required to tell which node belongs to which data center and
>>>> switch for block placement.
>>>>
>>>> Thanks,
>>>> Rahul
>>>>
>>>>
>>>> On Fri, Aug 30, 2013 at 12:42 AM, Baskar Duraikannu <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>> We have a need to setup hadoop across data centers.  Does hadoop
>>>>> support multi data center configuration? I searched through archives and
>>>>> have found that hadoop did not support multi data center configuration some
>>>>> time back. Just wanted to see whether situation has changed.
>>>>>
>>>>> Please help.
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> *
>>> *
>>> *
>>> *
>>> *Adam Muise*
>>> Solution Engineer
>>> *Hortonworks*
>>> [EMAIL PROTECTED]
>>> 416-417-4037
>>>
>>> Hortonworks - Develops, Distributes and Supports Enterprise Apache
>>> Hadoop. <http://hortonworks.com/>
>>>
>>> Hortonworks Virtual Sandbox <http://hortonworks.com/sandbox>
>>>
>>> Hadoop: Disruptive Possibilities by Jeff Needham<http://hortonworks.com/resources/?did=72&cat=1>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>>
>>>
>>
>