Kafka, mail # user - Kafka low-latency usage - 2013-07-24, 15:04
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
Kafka low-latency usage
Hi all,

I'm considering to use the Kafka as a low-latency message system. I want to have a system, that is able to minimise the delay between sending from producer and reading from consumer. I created a test on localhost, I created one consumer & producer and I send messages measuring the latency an it seems to be very low: ~5 millis.

My question is, it Kafka meant to used as this? One of the use-case that Kafka website suggests is activity-stream, that is, a use-case, that is in real-time, but if the latency is like 1 second, it is not an issue. My use-case is more something like chat room.

The subtitle of Kafka says: "A high-throughput distributed messaging system.", does it apply for all the  Kafka versions or did Kafka changed over the time? There is a thread in the archive named "end-to-end latency in kafka 0.8", It looks like it might be the case, that the Kafka is capable/targeting to do low-latency messaging.

Thanks for reading,
Jakub Ryška
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB