Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com metrics + logs = try SPM and Logsene for free
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Relationship between Zookeeper and Kafka


+
Jason Weiss 2013-05-20, 16:36
+
Scott Clasen 2013-05-20, 16:56
+
Jason Weiss 2013-05-20, 17:02
+
Scott Clasen 2013-05-20, 17:17
Copy link to this message
-
Re: Relationship between Zookeeper and Kafka
Hi Jason,

On May 20, 2013, at 10:01am, Jason Weiss wrote:
In my experience directly hitting an ephemeral drive on m1.large is faster than using EBS.

I've seen some articles where RAIDing multiple EBS volumes can exceed the performance of ephemeral drives, but with high variability.

If you want to maximize performance, set up up a (smaller) cluster of SSD-backed instances with 10Gb Ethernet in the same cluster group.

E.g. test with three cr1.8xlarge instances.
Ken Krugler
+1 530-210-6378
http://www.scaleunlimited.com
custom big data solutions & training
Hadoop, Cascading, Cassandra & Solr
 
+
Philip OToole 2013-05-21, 15:45
+
Jason Weiss 2013-05-21, 15:52
+
Philip OToole 2013-05-21, 15:58
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB