Kafka, mail # user - Re: message order, guarenteed? - 2013-06-14, 15:02
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Plain View
+
S Ahmed 2013-06-10, 00:33
+
Neha Narkhede 2013-06-10, 12:37
+
David Arthur 2013-06-14, 14:37
Copy link to this message
-
Re: message order, guarenteed?
Another idea. If a set of messages arrive over a single TCP connection, route to a partition depending on TCP connection.

To be honest, these approaches, while they work, may not scale when the message rate is high. If at all possible, try to think of a way to remove this requirement from your design. For example, a design might have a sequence number assigned to each message before it goes into Kafka (a time-based UUID, for example), and something later in the pipe line sorts it all out. Kafka then does what is does best, IMHO, a high-performance reliable, message bus.

Philip

On Jun 14, 2013, at 7:37 AM, David Arthur <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB