I was thinking (and after doing some tests on dedicated and ec2), would you
still say kafka is io intensive?
Considering writes are batched every x seconds, and you have a single kafka
server on a given instance, and consumers are just streaming the data in
sequential order (the disk head isn't jumping around), is it safe to say
kafka isn't that io intensive to the point that running it on ec2 should be
just as good as dedicated hardware?
I was getting pretty good results on ec2 so this thought came to me...
Jun Rao 2012-05-11, 14:34
S Ahmed 2012-05-11, 15:03
Jun Rao 2012-05-11, 16:10
S Ahmed 2012-05-11, 16:16
Jay Kreps 2012-05-11, 23:10
S Ahmed 2012-05-12, 01:21