Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: Question about HA and Federation


Copy link to this message
-
Re: Question about HA and Federation
Thank you Harsh J.

first point checked (decide what to do) now I have to do it ;-)

Kind regards,

ESGLinux

2012/12/21 Harsh J <[EMAIL PROTECTED]>

> Appears alright to me!
>
> On Fri, Dec 21, 2012 at 1:15 PM, ESGLinux <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > Finally I´m going to try this:
> >
> > 1 Machine: Active Name Node for NS1
> > 1 Machine: Passive Name Node for NS1
> > 1 Machine: NameNode for NS2 + NameNode for NS3
> > 1 Machine: Secondary NameNode for NS2 + Secondary NameNode for NS3
> >
> > Is this correct?
> >
> > thanks,
> >
> > ESGLinux
> >
> > 2012/12/20 Harsh J <[EMAIL PROTECTED]>
> >>
> >> Btw, you can co-locate NameNodes (unique namespace ones) onto the same
> >> machine if you need to - the configs easily allow this via rpc/http
> >> port specifiers.
> >>
> >> On Thu, Dec 20, 2012 at 11:33 PM, ESGLinux <[EMAIL PROTECTED]> wrote:
> >> > Thank you very much,
> >> >
> >> > your answer have clarified me these concepts very much,
> >> >
> >> > I didn't understand how could I mix HA and Federation and how many
> nodes
> >> > I
> >> > need....
> >> >
> >> > Kind Regards,
> >> >
> >> > ESGLinux,
> >> >
> >> > 2012/12/20 Harsh J <[EMAIL PROTECTED]>
> >> >>
> >> >> Yes I think its safe to say that - sorry that I missed out SNNs in my
> >> >> first response (I counted only the regular serving namenodes) :)
> >> >>
> >> >> On Thu, Dec 20, 2012 at 11:25 PM, ESGLinux <[EMAIL PROTECTED]>
> wrote:
> >> >> > Hi again,
> >> >> >
> >> >> > So finally the number of nodes are these:
> >> >> >
> >> >> > 1 Active NameNode + 1 Passive NameNode (it does the work of the old
> >> >> > Secondary NameNode) for NS1 NameSpace (these are 2 diferent
> machines)
> >> >> > 1 NameNode for NS2 + 1 Secondary NameNode
> >> >> > 1 NameNode for NS3 + 1 Secondary NameNode
> >> >> >
> >> >> > We can say that we need 2 nodes per NameSpace, is that true?
> >> >> >
> >> >> > Thanks,
> >> >> >
> >> >> > ESGLinux
> >> >> >
> >> >> >
> >> >> >
> >> >> > 2012/12/20 Harsh J <[EMAIL PROTECTED]>
> >> >> >>
> >> >> >> Hi,
> >> >> >>
> >> >> >> To put it simply: If you use a NameNode, you need a
> >> >> >> SecondaryNameNode.
> >> >> >> In HA-mode, a StandbyNameNode acts as a SecondaryNameNode (so you
> >> >> >> don't need to run an extra).
> >> >> >>
> >> >> >> Either way, you definitely need the checkpoint operation happening
> >> >> >> and
> >> >> >> being monitored for.
> >> >> >>
> >> >> >> On Thu, Dec 20, 2012 at 11:09 PM, ESGLinux <[EMAIL PROTECTED]>
> >> >> >> wrote:
> >> >> >> > Hi Harsh,
> >> >> >> >
> >> >> >> > First thank you very much for your answer,
> >> >> >> >
> >> >> >> > following your example:
> >> >> >> >
> >> >> >> > You have:
> >> >> >> >
> >> >> >> > 1 Active NameNode + 1 Passive NameNode (it does the work of the
> >> >> >> > old
> >> >> >> > Secondary NameNode) for NS1 NameSpace (these are 2 diferent
> >> >> >> > machines)
> >> >> >> > 1 NameNode for NS2
> >> >> >> > 1 NameNode for NS3
> >> >> >> >
> >> >> >> > but what about the Secondary Name Nodes for NS2 and NS3? or I
> >> >> >> > don´t
> >> >> >> > need
> >> >> >> > it?
> >> >> >> > perhaps I´m mixing concepts....
> >> >> >> >
> >> >> >> > Thanks again,
> >> >> >> >
> >> >> >> > Greetings,
> >> >> >> >
> >> >> >> > ESGLinux
> >> >> >> >
> >> >> >> >
> >> >> >> >
> >> >> >> >
> >> >> >> > 2012/12/20 Harsh J <[EMAIL PROTECTED]>
> >> >> >> >>
> >> >> >> >> Hi ESGLinux,
> >> >> >> >>
> >> >> >> >> Federation and HA are two distinct features that share some
> >> >> >> >> common
> >> >> >> >> properties but nothing more. You can turn on HA for any
> selected
> >> >> >> >> Namespace but it is not necessarily needed to be that all
> >> >> >> >> Namespaces
> >> >> >> >> have HA.
> >> >> >> >>
> >> >> >> >> Perhaps an example will clear it up for you.
> >> >> >> >>
> >> >> >> >> I have a local instance that is configured to run several
> >> >> >> >> namespaces:
> >> >> >> >> ns1, ns2, and ns3 (Federated Namespaces).
> >> >> >> >> The namespace ns1 hosts my HBase tables and is critical to me,
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB