Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - max.message.size, 0.7 SyncProducer, and compression


Copy link to this message
-
max.message.size, 0.7 SyncProducer, and compression
Philip O'Toole 2014-01-28, 15:42
http://kafka.apache.org/07/configuration.html

Hello -- I can look the at the code too, but how does this setting interact
with compression? After all, a Producer doing compression doesn't know the
size of a "message" on the wire it will send to a Kafka broker until after
it has been compressed. And after it has been compressed, what if it is
greater than the configured value?

Or perhaps it applies to the "message" pre-compression?

Thanks,

Philip