Publisher (using librdkafka C api) has sent both gzip and snappy compressed messages. I find that the java Simple Consumer ( https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example#) is unable to read the snappy ones, while the High Level one is. Is this expected? Is there something you have to do in order to handle the snappy messages? There is no error messages provided, it simply acts as if there are no further messages.
Re: Unable to consume Snappy compressed messages with Simple Consumer
that worked! My publisher is sending 1MB payload and compressing it with snappy. I would have thought that with compression that it would have fit into the 100000 bytes default of the sample code. I guess not!
Thanks. On Thu, Feb 27, 2014 at 1:37 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by Sematext