Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - since flushes are batched, is it still io intensive?


Copy link to this message
-
since flushes are batched, is it still io intensive?
S Ahmed 2012-05-11, 14:13
I was thinking (and after doing some tests on dedicated and ec2), would you
still say kafka is io intensive?

Considering writes are batched every x seconds, and you have a single kafka
server on a given instance, and consumers are just streaming the data in
sequential order (the disk head isn't jumping around), is it safe to say
kafka isn't that io intensive to the point that running it on ec2 should be
just as good as dedicated hardware?

I was getting pretty good results on ec2 so this thought came to me...