Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Thread Safety of KafkaStreams


Copy link to this message
-
Thread Safety of KafkaStreams
Hello,

We want to process messages from a single KafkaStream in a number of
processes. Is it possible to have this code executing in multiple threads
against the same stream?

for (message <- stream) {
  someBlockingOperation(message)
}

The scaladocs mention thread safety, but some of the code seems fairly
stateful. I was wondering if anyone has experience with this or knows if it
will work?
Thanks,

David
+
Neha Narkhede 2012-11-21, 06:19
+
David Arthur 2012-11-21, 13:55
+
David Ross 2012-11-21, 15:52
+
Jay Kreps 2012-11-21, 15:56
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB