Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # dev >> [jira] [Created] (KAFKA-746) Snappy compression isn't applied to messages written to disk on broker


Copy link to this message
-
[jira] [Created] (KAFKA-746) Snappy compression isn't applied to messages written to disk on broker
Esko Suomi created KAFKA-746:
--------------------------------

             Summary: Snappy compression isn't applied to messages written to disk on broker
                 Key: KAFKA-746
                 URL: https://issues.apache.org/jira/browse/KAFKA-746
             Project: Kafka
          Issue Type: Bug
          Components: producer
    Affects Versions: 0.7.2
            Reporter: Esko Suomi
            Assignee: Jun Rao
            Priority: Minor
We recently tested 0.7.2 performance using different compression codecs for messages and noticed that when using Snappy (compression.codec = 2 in Producer configuration) the messages written to topic partitions were written without compression. Compared to GZIP (compression.codec = 1) this is especially peculiar since with GZIP the partition files themselves were compressed as expected.

I did walk through the 0.8 code briefly and didn't spot any obvious reasons why this would be happening so I'm now handing this issue completely into your able hands.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira