-Re: Dynamically adding nodes in Hadoop
madhu phatak 2012-01-03, 14:17
Thanks for all the input. I am trying to do cluster setup in EC2 but not
able to find how i can do dns updation centrally. If anyone one knows how
to do this please help me ..
On Sat, Dec 17, 2011 at 8:10 PM, Michel Segel <[EMAIL PROTECTED]>wrote:
> Actually I would recommend avoiding /etc/hosts and using DNS if this is
> going to be a production grade cluster...
> Sent from a remote device. Please excuse any typos...
> Mike Segel
> On Dec 17, 2011, at 5:40 AM, alo alt <[EMAIL PROTECTED]> wrote:
> > Hi,
> > in the slave - file too. /etc/hosts is also recommend to avoid DNS
> > issues. After adding in slaves the new node has to be started and
> > should quickly appear in the web-ui. If you don't need the nodes all
> > time you can setup a exclude and refresh your cluster
> > (
> > - Alex
> > On Sat, Dec 17, 2011 at 12:06 PM, madhu phatak <[EMAIL PROTECTED]>
> >> Hi,
> >> I am trying to add nodes dynamically to a running hadoop cluster.I
> >> tasktracker and datanode in the node. It works fine. But when some node
> >> try fetch values ( for reduce phase) it fails with unknown host
> >> When i add a node to running cluster do i have to add its hostname to
> >> nodes (slaves +master) /etc/hosts file? Or some other way is there?
> >> --
> >> Join me at http://hadoopworkshop.eventbrite.com/
> > --
> > Alexander Lorenz
> > http://mapredit.blogspot.com
> > P Think of the environment: please don't print this email unless you
> > really need to.
Join me at http://hadoopworkshop.eventbrite.com/