Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Re: Binary Data and Kafka


Copy link to this message
-
Re: Binary Data and Kafka
Jun Rao 2013-05-08, 15:26
No. Kafka broker stores the binary data as it is. The binary data may be
compressed, if compression is enabled at the producer.

Thanks,

Jun
On Wed, May 8, 2013 at 5:57 AM, Sybrandy, Casey <
[EMAIL PROTECTED]> wrote:

> All,
>
> Does the Kafka broker Base64 encode the messages?  We are sending binary
> data to the brokers and I looked at the logs to confirm that they data was
> being stored, however all of the data, with a few exceptions, looks to be
> Base64 encoded.  I didn't expect this, so I wanted to ask and confirm what
> I'm seeing.
>
> If this is true, does this affect the size of the message when fetching?
>  In other words, if I send a 100K message, do I have to make sure I can
> fetch a 300K message since the message can now be 300K in size because of
> the encoding?
>
> Casey Sybrandy MSWE
> Six3Systems
> Cyber and Enterprise Systems Group
> www.six3systems.com
> 301-206-6000 (Office)
> 301-206-6020 (Fax)
> 11820 West Market Place
> Suites N-P
> Fulton, MD. 20759
>
>