Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Re: Binary Data and Kafka

Copy link to this message
Re: Binary Data and Kafka
No. Kafka broker stores the binary data as it is. The binary data may be
compressed, if compression is enabled at the producer.


On Wed, May 8, 2013 at 5:57 AM, Sybrandy, Casey <

> All,
> Does the Kafka broker Base64 encode the messages?  We are sending binary
> data to the brokers and I looked at the logs to confirm that they data was
> being stored, however all of the data, with a few exceptions, looks to be
> Base64 encoded.  I didn't expect this, so I wanted to ask and confirm what
> I'm seeing.
> If this is true, does this affect the size of the message when fetching?
>  In other words, if I send a 100K message, do I have to make sure I can
> fetch a 300K message since the message can now be 300K in size because of
> the encoding?
> Casey Sybrandy MSWE
> Six3Systems
> Cyber and Enterprise Systems Group
> www.six3systems.com
> 301-206-6000 (Office)
> 301-206-6020 (Fax)
> 11820 West Market Place
> Suites N-P
> Fulton, MD. 20759