Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Re: Install hadoop on multiple VMs in 1 laptop like a cluster


Copy link to this message
-
Re: Install hadoop on multiple VMs in 1 laptop like a cluster
Jay Vyas 2013-05-31, 15:11
Just FYI if you are on linux, KVM and kickstart are really good for this as
well and we have some kickstart Fedora16 hadoop setup scripts I can share
to spin up a cluster of several VMs on the fly with static IPs (that
usually to me is the tricky part with hadoop VM cluster setup - setting up
the VMs with static ip addresses, getting the nodes to talk / ssh to each
other, and consistently defining the slaves file).

But if you are stuck with VMWare, then i beleive VMWare also has a vagrant
plugin now, which will be much easier for you to maintain.

Manually cloning machines doesnt scale well when you want to rebuild your
cluster.

On Fri, May 31, 2013 at 10:56 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:

> Hi Sai Sai,
>
> You can take a look at that also: http://goo.gl/iXzae
>
> I just did that yesterday for some other folks I'm working with. Maybe
> not the best way, but working like a charm.
>
> JM
>
> 2013/5/31 shashwat shriparv <[EMAIL PROTECTED]>:
> > Try this
> > http://www.youtube.com/watch?v=gIRubPl20oo
> > there will be three videos 1-3 watch and you can do what you need to
> do....
> >
> >
> >
> > Thanks & Regards
> >
> > ∞
> >
> > Shashwat Shriparv
> >
> >
> >
> > On Fri, May 31, 2013 at 5:52 PM, Jitendra Yadav <
> [EMAIL PROTECTED]>
> > wrote:
> >>
> >> Hi,
> >>
> >> You can create a clone machine through an existing virtual machine in
> >> VMware and then run it as a separate virtual machine.
> >>
> >> http://www.vmware.com/support/ws55/doc/ws_clone_new_wizard.html
> >>
> >>
> >> After installing you have to make sure that all the virtual machines are
> >> setup with correct network set up so that they can ping each other (you
> >> should use Host only network settings in network configuration).
> >>
> >> I hope this will help you.
> >>
> >>
> >> Regards
> >> Jitendra
> >>
> >> On Fri, May 31, 2013 at 5:23 PM, Sai Sai <[EMAIL PROTECTED]> wrote:
> >>>
> >>> Just wondering if anyone has any documentation or references to any
> >>> articles how to simulate a multi node cluster setup in 1 laptop with
> hadoop
> >>> running on multiple ubuntu VMs. any help is appreciated.
> >>> Thanks
> >>> Sai
> >>
> >>
> >
>

--
Jay Vyas
http://jayunit100.blogspot.com