Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: Multidata center support


Copy link to this message
-
Re: Multidata center support
What do you think friends I think hadoop clusters can run on multiple data
centers using FEDERATION
On Sat, Aug 31, 2013 at 8:39 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:

> The only problem i guess hadoop wont be able to duplicate data from one
> data center to another but i guess i can identify data nodes or namenodes
> from another data center correct me if i am wrong
>
>
> On Sat, Aug 31, 2013 at 7:00 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:
>
>> lets say that
>>
>> you have some machines in europe and some  in US I think you just need
>> the ips and configure them in your cluster set up
>> it will work...
>>
>>
>> On Sat, Aug 31, 2013 at 7:52 AM, Jun Ping Du <[EMAIL PROTECTED]> wrote:
>>
>>> Hi,
>>>     Although you can set datacenter layer on your network topology, it
>>> is never enabled in hadoop as lacking of replica placement and task
>>> scheduling support. There are some work to add layers other than rack and
>>> node under HADOOP-8848 but may not suit for your case. Agree with Adam that
>>> a cluster spanning multiple data centers seems not make sense even for DR
>>> case. Do you have other cases to do such a deployment?
>>>
>>> Thanks,
>>>
>>> Junping
>>>
>>> ------------------------------
>>> *From: *"Adam Muise" <[EMAIL PROTECTED]>
>>> *To: *[EMAIL PROTECTED]
>>> *Sent: *Friday, August 30, 2013 6:26:54 PM
>>> *Subject: *Re: Multidata center support
>>>
>>>
>>> Nothing has changed. DR best practice is still one (or more) clusters
>>> per site and replication is handled via distributed copy or some variation
>>> of it. A cluster spanning multiple data centers is a poor idea right now.
>>>
>>>
>>>
>>>
>>> On Fri, Aug 30, 2013 at 12:35 AM, Rahul Bhattacharjee <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> My take on this.
>>>>
>>>> Why hadoop has to know about data center thing. I think it can be
>>>> installed across multiple data centers , however topology configuration
>>>> would be required to tell which node belongs to which data center and
>>>> switch for block placement.
>>>>
>>>> Thanks,
>>>> Rahul
>>>>
>>>>
>>>> On Fri, Aug 30, 2013 at 12:42 AM, Baskar Duraikannu <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>> We have a need to setup hadoop across data centers.  Does hadoop
>>>>> support multi data center configuration? I searched through archives and
>>>>> have found that hadoop did not support multi data center configuration some
>>>>> time back. Just wanted to see whether situation has changed.
>>>>>
>>>>> Please help.
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> *
>>> *
>>> *
>>> *
>>> *Adam Muise*
>>> Solution Engineer
>>> *Hortonworks*
>>> [EMAIL PROTECTED]
>>> 416-417-4037
>>>
>>> Hortonworks - Develops, Distributes and Supports Enterprise Apache
>>> Hadoop. <http://hortonworks.com/>
>>>
>>> Hortonworks Virtual Sandbox <http://hortonworks.com/sandbox>
>>>
>>> Hadoop: Disruptive Possibilities by Jeff Needham<http://hortonworks.com/resources/?did=72&cat=1>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>>
>>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB