Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Payload size exception


Copy link to this message
-
Re: Payload size exception
Ok so it might be an issue somewhere in the pipeline (I'm guessing memory
issues?).

They are xml files, and that 30-100 was uncompressed.
On Tue, Jan 29, 2013 at 12:28 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:

> > At linkedin, what is the largest payload size per message you guys have
> in
> > production?
> >
>
> Roughly 30K after compression, but that is fairly rare. Most messages are <
> 500 bytes after compression.
>
> Thanks,
> Neha
>