And to be clear, if uncompressed messages come in, they remain uncompressed
in the broker, correct?
Currently, only the broker has knowledge of the offsets for a partition and
hence is the right place to assign the offsets. Even if the producer sends
metadata, the broker still needs to decompress the data in order to get a
handle to the individual message in order to assign the logical offset.
One of the JIRAs discussing this is here -https://issues.apache.org/jira/browse/KAFKA-595
On Tue, Oct 8, 2013 at 9:24 AM, Jason Rosenberg <[EMAIL PROTECTED]> wrote: