Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> AWS MapReduce


Copy link to this message
-
Re: AWS MapReduce
As far as I see in the docs it looks like you could also use hdfs instead
of s3. But what I am not sure is if these are local disks or EBS.

On Sun, Mar 4, 2012 at 2:27 AM, Hannes Carl Meyer <[EMAIL PROTECTED]
> wrote:

> Hi,
>
> yes, its loaded from S3. Imho is Amazon AWS Map-Reduce pretty slow.
> The setup is done pretty fast and there are some configuration parameters
> you can bypass - for example blocksizes etc. - but in the end imho setting
> up ec2 instances by copying images is the better alternative.
>
> Kind Regards
>
> Hannes
>
> On Sun, Mar 4, 2012 at 2:31 AM, Mohit Anchlia <[EMAIL PROTECTED]
> >wrote:
>
> > I think found answer to this question. However, it's still not clear if
> > HDFS is on local disk or EBS volumes. Does anyone know?
> >
> > On Sat, Mar 3, 2012 at 3:54 PM, Mohit Anchlia <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Just want to check  how many are using AWS mapreduce and understand the
> > > pros and cons of Amazon's MapReduce machines? Is it true that these map
> > > reduce machines are really reading and writing from S3 instead of local
> > > disks? Has anyone found issues with Amazon MapReduce and how does it
> > > compare with using MapReduce on local attached disks compared to using
> > S3.
> >
>
> ---
> www.informera.de
> Hadoop & Big Data Services
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB