kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Rubin <ira...@icloud.com.INVALID>
Subject Default values for max.request.size and message.max.bytes seem wrong
Date Tue, 03 Mar 2020 19:34:30 GMT
(I am re-asking my SO question: https://stackoverflow.com/questions/60458132/default-values-for-max-request-size-and-message-max-bytes-seem-wrong

The default value for the Producer setting max.request.size is 1048576. This controls the
maximum size of a request (to a broker) in bytes.

The default value for the Broker setting message.max.bytes is 1000012. This controls the largest
(record batch) size allowed (by the Kafka server/broker).

1048576 > 1000012

It seems that the defaults are such that a Producer (with this default value) could happen
to produce a message which is larger than a Broker (with this default value) will accept,
resulting in MESSAGE_TOO_LARGE errors.

Am I misunderstanding these configuration settings? Or are the Kafka defaults really such
that it is possible to get MESSAGE_TOO_LARGE errors with the default values?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message