-Re: Need to know steps of installation of Hadoop 0.23
Jonathan Eagles 2011-12-07, 15:25
Also have a look at this good reference of information.
On Wed, Dec 7, 2011 at 7:53 AM, Praveen Sripati <[EMAIL PROTECTED]>wrote:
> As Roman said the documentation for 0.23 release is spread out. I tried to
> consolidate the information I come across. The below link has references to
> Architecture, Code, Video, Build, Deploy etc. It would be better to get
> sometime like this into the Apache documentation.
> On Wed, Dec 7, 2011 at 1:21 AM, Roman Shaposhnik <[EMAIL PROTECTED]> wrote:
> > Hi Ulhas,
> > On Tue, Dec 6, 2011 at 12:20 AM, Ulhas Shringare
> > <[EMAIL PROTECTED]> wrote:
> > > Hello,
> > > I need to know steps to install Hadoop 0.23 , every where there are
> > > to install hadoop 0.20.
> > > And there are bit difference between them.Like conf/hadoop-env config
> > file
> > > is not there.
> > > Please provide me suitable information or link.
> > I agree with you that the information on configuring .23 is scarce (it
> > is actually
> > available if you dig for it, but you have to be persistent). It also
> > depends on
> > what OS you would like to run it on.
> > If you happen to be on RPM-based system, you can utilize the
> > *pre-release* packages
> > that Bigtop is publishing over here:
> > You can simply follow the instructions on how to install that are
> > published on our
> > wiki, provided that you change the URL for the repo file to the ones
> > mentioned above:
> > This will give you a pseudo distributed cluster that works and you can
> > inspect what
> > kind of settings we had to put in place. All the config files are
> > found in the usual Linux
> > place of /etc/hadoop/conf and /etc/yarn/conf.
> > If you want to deploy to a multinode configuration, you can use the
> > code
> > that we've created:
> > You simply need to run the following command on every node of your
> > FACTER_hadoop_head_node="FQDN" puppet --modulepath
> > bigtop-deploy/puppet/modules bigtop-deploy/puppet/manifests/site.pp
> > where FQDN is a fully qualified domain name for a node that you want all
> > the
> > "centralized" services to run on (NameNode, etc.)
> > Hope this helps. And remember -- instead of jobtracker there's now
> > resoruce manager
> > and instead of tasktracker there's now a nodemanger. So the services are
> > name
> > accordingly.
> > Thanks,
> > Roman.