Kafka, mail # user - Re: Relationship between Zookeeper and Kafka - 2013-05-20, 17:44
 Search Hadoop and all its subprojects:

Switch to Plain View
Jason Weiss 2013-05-20, 16:36
Scott Clasen 2013-05-20, 16:56
Jason Weiss 2013-05-20, 17:02
Scott Clasen 2013-05-20, 17:17
Copy link to this message
Re: Relationship between Zookeeper and Kafka
Hi Jason,

On May 20, 2013, at 10:01am, Jason Weiss wrote:
In my experience directly hitting an ephemeral drive on m1.large is faster than using EBS.

I've seen some articles where RAIDing multiple EBS volumes can exceed the performance of ephemeral drives, but with high variability.

If you want to maximize performance, set up up a (smaller) cluster of SSD-backed instances with 10Gb Ethernet in the same cluster group.

E.g. test with three cr1.8xlarge instances.
Ken Krugler
+1 530-210-6378
custom big data solutions & training
Hadoop, Cascading, Cassandra & Solr
Philip OToole 2013-05-21, 15:45
Jason Weiss 2013-05-21, 15:52
Philip OToole 2013-05-21, 15:58
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB