Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> memory requirement for kafka - how to estimate


Copy link to this message
-
Re: memory requirement for kafka - how to estimate
Hi,

I'm not sure if anyone can give you exact numbers, but I think you'll find
Kafka brokers very light.  We run them on .... I think medium EC2 instances
and Kafka brokers they put hardly any strain on them.  If it helps give you
an idea, go to https://apps.sematext.com/demo and look for "SA.Prod.Kafka".
 That's one of our Kafka "clusters".  You'll see how many messages this
processes, what their size is, a bunch of other metrics, and then the JVM
Memory info, which I hope gives you some idea of the footprint.

Otis
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/
On Wed, Feb 26, 2014 at 3:41 AM, Arjun <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB