Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Adding packages to the HBase AMI (ami-fe698397 and ami-c86983a1) - no space on device


Copy link to this message
-
Re: Adding packages to the HBase AMI (ami-fe698397 and ami-c86983a1) - no space on device
Saptarshi Guha 2010-11-19, 22:31
True, and thanks for putting the scripts together. But doesn't yum demand
free space on the / device?
There is plenty of space on /mnt but then do instruct yum to install
packages elsewhere. I'd have to link /lib/ etc to
/mnt or something.

Cheers
J
On Fri, Nov 19, 2010 at 2:27 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:

> The root device on instance-store type instances is small, but there are
> several additional disk volumes supplied depending on the instance size, 2
> 420 GB volumes for m1.xlarge and 4 420 GB volumes for c1.xlarge.
>
> Our ec2 scripts mount them as /mnt, /mnt2, /mnt3, etc. and configure the
> Hadoop DataNode to use them for block storage. You can change this and use
> this storage for something else.
>
> Or, you can always create EBS volumes on demand and attach them to your
> instance, and use bind mounts ('mount --bind ...') to hang the additional
> storage off arbitrary points in your filesystem hierarchy.
>
> Best regards,
>
>    - Andy
>
>
> --- On Fri, 11/19/10, Saptarshi Guha <[EMAIL PROTECTED]> wrote:
>
> > From: Saptarshi Guha <[EMAIL PROTECTED]>
> > Subject: Re: Adding packages to the HBase AMI (ami-fe698397 and
> ami-c86983a1) - no space on device
> > To: [EMAIL PROTECTED]
> > Date: Friday, November 19, 2010, 2:18 PM
> > I Think i found the answer. It
> > appears this AMI was bundled with 3GB but
> > there is no compelling reason to do so.
> > I can recreate an AMI from the c1.xlarge AMI bundling it
> > with e.g. 5GB. That
> > should cover my needs.
> > I honestly don't mind 5 minute start up times - coffee and
> > a cigarette - or
> > is there something more to it than just longer start up
> > times?
> >
> >
> > Cheers and thanks
> >
> > Joy
> >
> > On Fri, Nov 19, 2010 at 2:11 PM, Saptarshi Guha <
> [EMAIL PROTECTED]>wrote:
> >
> > > Hello,
> > >
> > > Both packages have HBAse 0.89.20100726 installed, the
> > former is c1.xlarge
> > > and the latter is medium).
> > > I'm trying to install some extra packages (see [1])
> > >
> > > By the time I've come to install R, I'm almost out of
> > space on the root
> > > device. I would like to add some packages to the
> > > task nodes (which are laucnehd from the c1.xlarge
> > instance)  and install
> > > thrift - but I can't even get to the point.
> > >
> > > The images start of with 3Gb on the root device and
> > 2.3 used. By the time
> > > it comes to the last yum, there is about <<
> > 200MB left.
> > > R requires 444 mb.
> > >
> > > Q1: Are there ways to increase the size of the
> > root device?
> > > Q2: Any other ideas?
> > >
> > > Thanks for all your thoughts.
> > >
> > > Cheers
> > > Joy
> > >
> > >
> > >
> > > [1]
> > >
> > > yum update
> > > yum upgrade
> > >
> > > yum install -y gcc-c++.x86_64
> > > yum install -y ant automake libtool flex bison
> > pkgconfig libevent-devel
> > > ruby-devel php php-devel
> > > yum install -y boost-devel libevent-devel libtool
> > > yum install -y atlas-devel atlas-sse-devel
> > atlas-sse2-devel
> > > yum install -y R
> > >
> > >
> >
>
>
>
>