Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Need to know steps of installation of Hadoop 0.23


Copy link to this message
-
Re: Need to know steps of installation of Hadoop 0.23
Also have a look at this good reference of information.

http://hadoop.apache.org/common/docs/r0.23.0/

On Wed, Dec 7, 2011 at 7:53 AM, Praveen Sripati <[EMAIL PROTECTED]>wrote:

> Ulhas,
>
> As Roman said the documentation for 0.23 release is spread out. I tried to
> consolidate the information I come across. The below link has references to
> Architecture, Code, Video, Build, Deploy etc. It would be better to get
> sometime like this into the Apache documentation.
>
> http://hadoop-tips.blogspot.com/p/mrv2-resources.html
>
> Regards,
> Praveen
>
> On Wed, Dec 7, 2011 at 1:21 AM, Roman Shaposhnik <[EMAIL PROTECTED]> wrote:
>
> > Hi Ulhas,
> >
> > On Tue, Dec 6, 2011 at 12:20 AM, Ulhas Shringare
> > <[EMAIL PROTECTED]> wrote:
> > > Hello,
> > > I need to know steps to install Hadoop 0.23 , every where there are
> steps
> > > to install hadoop 0.20.
> > > And there are bit difference between them.Like conf/hadoop-env config
> > file
> > > is not there.
> > > Please provide me suitable information or link.
> >
> > I agree with you that the information on configuring .23 is scarce (it
> > is actually
> > available if you dig for it, but you have to be persistent). It also
> > depends on
> > what OS you would like to run it on.
> >
> > If you happen to be on RPM-based system, you can utilize the
> > *pre-release* packages
> > that Bigtop is publishing over here:
> >
> >
> http://bigtop01.cloudera.org:8080/view/Hadoop%200.23/job/Bigtop-23-matrix/label=centos5/lastSuccessfulBuild/artifact/output/
> >
> >
> http://bigtop01.cloudera.org:8080/view/Hadoop%200.23/job/Bigtop-23-matrix/label=sles11/lastSuccessfulBuild/artifact/output/
> >
> > You can simply follow the instructions on how to install that are
> > published on our
> > wiki, provided that you change the URL for the repo file to the ones
> > mentioned above:
> >
> >
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
> >
> > This will give you a pseudo distributed cluster that works and you can
> > inspect what
> > kind of settings we had to put in place. All the config files are
> > found in the usual Linux
> > place of /etc/hadoop/conf and /etc/yarn/conf.
> >
> > If you want to deploy to a multinode configuration, you can use the
> puppet
> > code
> > that we've created:
> >
> >
> https://svn.apache.org/repos/asf/incubator/bigtop/branches/hadoop-0.23/bigtop-deploy/puppet/
> >
> > You simply need to run the following command on every node of your
> cluster:
> >   FACTER_hadoop_head_node="FQDN" puppet --modulepath
> > bigtop-deploy/puppet/modules bigtop-deploy/puppet/manifests/site.pp
> > where FQDN is a fully qualified domain name for a node that you want all
> > the
> > "centralized" services to run on (NameNode, etc.)
> >
> > Hope this helps. And remember -- instead of jobtracker there's now
> > resoruce manager
> > and instead of tasktracker there's now a nodemanger. So the services are
> > name
> > accordingly.
> >
> > Thanks,
> > Roman.
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB