Kafka, mail # user - Re: understanding MessageSizeTooLarge and batches - 2013-09-27, 04:04
 Search Hadoop and all its subprojects:

Switch to Plain View
Jason Rosenberg 2013-09-27, 03:11
Copy link to this message
Re: understanding MessageSizeTooLarge and batches

Glad that you asked. This is only an issue if compression is turned on for
a batch of messages. The problem is that the compressed batch is treated as
a single message, whose size has to be smaller than max.message.bytes. If
you are sending data uncompressed, only each uncompressed message needs to
be less than max.message.bytes. The batch size doesn't really matter in
this case.


On Thu, Sep 26, 2013 at 8:11 PM, Jason Rosenberg <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB