kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Liam Clarke-Hutchinson <liam.cla...@adscale.co.nz>
Subject Re: Large messages max.message.bytes > message.max.bytes
Date Mon, 30 Nov 2020 19:35:53 GMT
Topic limits can't override broker limits.

On Tue, Dec 1, 2020 at 6:42 PM Sakke Ferraris <sakke@ferrasys.com> wrote:

> Hi all!
>
> I have questions regarding configuration for large messages. I understand
> that kafka has settings for broker and topic for message max sizes;
> message.max.bytes (broker config) and max.message.bytes (topic config).
>
> I wonder if max.message.bytes for a topic can be larger that the server
> default message.max.bytes? The problem I am facing is that now and then
> there are messages that hit the 1MB wall even compressed. It is rare that
> the messages get larger, but also there is no theoretical max size for the
> messages.
>
> I am not allowed to tamper with the general setting since it could have
> performance implications for all other users, but what could the
> performance implications be if the max.message.bytes is considerably higher
> on one topic?
>
> Best Regards, Sakke F
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message