kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Binary Data and Kafka
Date Wed, 08 May 2013 15:25:56 GMT
No. Kafka broker stores the binary data as it is. The binary data may be
compressed, if compression is enabled at the producer.



On Wed, May 8, 2013 at 5:57 AM, Sybrandy, Casey <
Casey.Sybrandy@six3systems.com> wrote:

> All,
> Does the Kafka broker Base64 encode the messages?  We are sending binary
> data to the brokers and I looked at the logs to confirm that they data was
> being stored, however all of the data, with a few exceptions, looks to be
> Base64 encoded.  I didn't expect this, so I wanted to ask and confirm what
> I'm seeing.
> If this is true, does this affect the size of the message when fetching?
>  In other words, if I send a 100K message, do I have to make sure I can
> fetch a 300K message since the message can now be 300K in size because of
> the encoding?
> Casey Sybrandy MSWE
> Six3Systems
> Cyber and Enterprise Systems Group
> www.six3systems.com
> 301-206-6000 (Office)
> 301-206-6020 (Fax)
> 11820 West Market Place
> Suites N-P
> Fulton, MD. 20759

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message