Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - AWS MapReduce


Copy link to this message
-
Re: AWS MapReduce
Mohit Anchlia 2012-03-04, 16:51
As far as I see in the docs it looks like you could also use hdfs instead
of s3. But what I am not sure is if these are local disks or EBS.

On Sun, Mar 4, 2012 at 2:27 AM, Hannes Carl Meyer <[EMAIL PROTECTED]
> wrote:

> Hi,
>
> yes, its loaded from S3. Imho is Amazon AWS Map-Reduce pretty slow.
> The setup is done pretty fast and there are some configuration parameters
> you can bypass - for example blocksizes etc. - but in the end imho setting
> up ec2 instances by copying images is the better alternative.
>
> Kind Regards
>
> Hannes
>
> On Sun, Mar 4, 2012 at 2:31 AM, Mohit Anchlia <[EMAIL PROTECTED]
> >wrote:
>
> > I think found answer to this question. However, it's still not clear if
> > HDFS is on local disk or EBS volumes. Does anyone know?
> >
> > On Sat, Mar 3, 2012 at 3:54 PM, Mohit Anchlia <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Just want to check  how many are using AWS mapreduce and understand the
> > > pros and cons of Amazon's MapReduce machines? Is it true that these map
> > > reduce machines are really reading and writing from S3 instead of local
> > > disks? Has anyone found issues with Amazon MapReduce and how does it
> > > compare with using MapReduce on local attached disks compared to using
> > S3.
> >
>
> ---
> www.informera.de
> Hadoop & Big Data Services
>