Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - hadoop high availability using terracotta


+
Gokul Prasad 2011-09-23, 18:06
Copy link to this message
-
Re: hadoop high availability using terracotta
Konstantin Boudnik 2011-09-23, 18:27
Gokul,

Terracotta is a fascinating framework which might be a bit of an overshot for a
small setup as well as adding another level of complexity in the form
Terracotta framework.

Quite interesting approach for NN's HA is Jini (aka ASF River) along with
JavaSpaces for the distributed storage of the meta-data. Using Jini also gives
you for free such benefits as auto-discovering making hot-swap of NN a non-issue.

I've been musing over this idea for some time and am trying to find some time
to actually experiment with it.

Cos

On Fri, Sep 23, 2011 at 11:36PM, Gokul Prasad wrote:
>    Hi,
>    Am trying to bring high availability in namenode(in hadoop cluster) for
>    small setup.
>    So the idea is to keep one extra namenode and use terracotta to replicate
>    the log(in memory details-jvm) from primary datacode to standby namenode,
>    if primary goes down secondary can take the primary role.
>    Now am bit confused how to start second namenode while the primary name
>    node up and running(with datanode connected) with keep relying the info
>    from primary thro terracotta. Is there a way to achieve this without
>    restarting namenode or datanode, any patch?
>    Please help and suggest me.
>    Regards,
>    Gokul
+
Gokul Prasad 2011-09-23, 19:05
+
GOEKE, MATTHEW 2011-09-23, 19:30
+
Gokul Prasad 2011-09-24, 16:32
+
GOEKE, MATTHEW 2011-09-26, 02:42