kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manoj Khangaonkar <khangaon...@gmail.com>
Subject Re: Optimal Message Size for Kafka
Date Sat, 08 Sep 2018 01:11:33 GMT
Best kafka performance is with messages size in the order of a few KB.
Larger messages put heavy load on brokers and is very inefficient. It is
inefficient on producers and consumers as well

regards

On Thu, Sep 6, 2018 at 11:16 PM SenthilKumar K <senthilec566@gmail.com>
wrote:

> Hello Experts,  We are planning to use Kafka for large message set ( size
> various from 2 MB to 4 MB  per event ). By setting message.max.bytes to 64
> MB  value this Kafka Producer allows large messages. But how does it
> impacts performance (both producer and consumer)?
>
> Would like to understand  the performance impact of different message size
> . Example : producing  50KB vs 1MB .
>
> What is the optimal message size can be used in Kafka Producer ?
>
> --Senthil
>


-- 
http://khangaonkar.blogspot.com/

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message