-Re: AWS MapReduce
Mohit Anchlia 2012-03-04, 16:51
As far as I see in the docs it looks like you could also use hdfs instead
of s3. But what I am not sure is if these are local disks or EBS.
On Sun, Mar 4, 2012 at 2:27 AM, Hannes Carl Meyer <[EMAIL PROTECTED]
> yes, its loaded from S3. Imho is Amazon AWS Map-Reduce pretty slow.
> The setup is done pretty fast and there are some configuration parameters
> you can bypass - for example blocksizes etc. - but in the end imho setting
> up ec2 instances by copying images is the better alternative.
> Kind Regards
> On Sun, Mar 4, 2012 at 2:31 AM, Mohit Anchlia <[EMAIL PROTECTED]
> > I think found answer to this question. However, it's still not clear if
> > HDFS is on local disk or EBS volumes. Does anyone know?
> > On Sat, Mar 3, 2012 at 3:54 PM, Mohit Anchlia <[EMAIL PROTECTED]
> > >wrote:
> > > Just want to check how many are using AWS mapreduce and understand the
> > > pros and cons of Amazon's MapReduce machines? Is it true that these map
> > > reduce machines are really reading and writing from S3 instead of local
> > > disks? Has anyone found issues with Amazon MapReduce and how does it
> > > compare with using MapReduce on local attached disks compared to using
> > S3.
> Hadoop & Big Data Services