-Ordering of messages in flume-ng
Chris Schneider 2014-02-12, 05:53
I've seen a fair number of resources on the web that describe the loose
ordering guarantees that flume offers for messages in the face of
degradation or failures. But I can't tell what applies to flume-og, and
flume-ng. Hopefully somebody can help clear up the situation.
In the case of a single agent topology, (source -> FileSystem Channel ->
sink), can messages become out of order? What situations cause that?
In a multi agent topology, does that answer change?
(Agent 1 Source -> FilesystemChannel -> Avro To Collector)
(Agent 2 Source -> FilesystemChannel -> Avro To Collector)
(Collector Avro from agents -> FilesystemChannel -> final Sink)
And perhaps in an even more complicated setup, with multiple collectors,
does that answer change further?