-Re: Multi-Master Hadoop Configuration
Konstantin Shvachko 2010-10-28, 21:09
Yes. Only one master, called name-node, is managing HDFS, and only one
master, called job tracker, is managing MapReduce cluster.
You can also read some online documentation, may be even publications.
On Wed, Oct 27, 2010 at 3:28 PM, Wang, Chengwei <[EMAIL PROTECTED]> wrote:
> Thanks for pointing it out!
> Because it did not mentioned how may masters in the practice of 4000 nodes,
> is there only one master managing 4000 slaves?
> ----- Original Message -----
> From: "Allen Wittenauer" <[EMAIL PROTECTED]>
> To: "<[EMAIL PROTECTED]>" <[EMAIL PROTECTED]>
> Sent: Wednesday, October 27, 2010 6:08:10 PM
> Subject: Re: Multi-Master Hadoop Configuration
> On Oct 27, 2010, at 2:55 PM, Wang, Chengwei wrote:
> > Hi All,
> > I've searched for a while on the possibility to configure multiple
> masters to govern large number of slaves, but I barely found any except for
> multi-masters for backup in HBase. Is one master enough to support thousands
> of slaves? Or in real we just configure separate Hadoop instances in a data
> center(I mean independent master-slaves sets on thousands of hosts)?
> > I really appreciate that someone here could enlighten me on those
> This is question #3 on the Hadoop FAQ.