Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Zookeeper, mail # user - EC2 disk configuration for zookeeper? One big disk or two smaller ones per node?


+
Brian Tarbox 2012-10-09, 13:03
+
Ted Dunning 2012-10-09, 15:29
+
Eric Fleischman 2012-10-09, 15:47
+
Ted Dunning 2012-10-09, 16:44
Copy link to this message
-
Re: EC2 disk configuration for zookeeper? One big disk or two smaller ones per node?
Andrew Purtell 2012-10-10, 00:06
I can ack Ted's experience.

Haven't tried the provisioned IOPS EBS volumes but if you want to try
those, be sure to select the "reserved IOPS optimized" instances or else
your storage traffic will still be multiplexed with instance networking.

On Wednesday, October 10, 2012, Ted Dunning wrote:

> I have some experience with these.
>
> On Tue, Oct 9, 2012 at 4:47 PM, Eric Fleischman <[EMAIL PROTECTED]<javascript:;>
> >wrote:
>
> > * Using high IOPS instances
> >
>
> Haven't tried this.
>
>
> > * Using multiple disks and doing OS level RAID across them to present a
> > single logical disk to the app
> >
>
> This typically is very dangerous unless you can somehow arrange for disks
> not to present lowest common denominator performance.
>
>
> > * Local vs. EBS volumes
> >
>
> Local tends to be much lower variance.  EBS can show 10:1 variations in
> performance.  Even the same volume can change dramatically over time.
>
>  * Standard vs. provisioned IOPS w/EBS
> >
>
> Haven't tried this.
>
--
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
+
JL 2012-10-10, 03:25