Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com metrics + logs = try SPM and Logsene for free
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Payload size exception


+
Bo Sun 2013-01-29, 08:18
+
Jay Kreps 2013-01-29, 16:05
+
Neha Narkhede 2013-01-29, 16:35
+
S Ahmed 2013-01-29, 16:57
+
Xavier Stevens 2013-01-29, 17:21
+
Neha Narkhede 2013-01-29, 17:28
Copy link to this message
-
Re: Payload size exception
Ack, right you are Neha, my bad.

WRT to how to set the maximum there are two considerations:
1. It should be smaller then the fetch size your consumers use
2. Messages are fully instantiated in memory so obscenely large messages
(say hundreds of mb) will cause a lot of memory allocation churn/problems.

-Jay
On Tue, Jan 29, 2013 at 8:57 AM, S Ahmed <[EMAIL PROTECTED]> wrote:
 
+
S Ahmed 2013-01-29, 19:00
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB