Publisher (using librdkafka C api) has sent both gzip and snappy compressed messages. I find that the java Simple Consumer ( https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example#) is unable to read the snappy ones, while the High Level one is. Is this expected? Is there something you have to do in order to handle the snappy messages? There is no error messages provided, it simply acts as if there are no further messages.
that worked! My publisher is sending 1MB payload and compressing it with snappy. I would have thought that with compression that it would have fit into the 100000 bytes default of the sample code. I guess not!
Thanks. On Thu, Feb 27, 2014 at 1:37 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext