kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manikumar <manikumar.re...@gmail.com>
Subject Re: How to increase network throughput of Kafka cluster?
Date Sat, 01 Apr 2017 17:39:14 GMT
Producer performance also depends on disk I/O.  You can try tuning
batch.size, compression.type configs.
also, add more partitions for more throughput.

Useful presentation:
https://www.slideshare.net/JiangjieQin/producer-performance-tuning-for-apache-kafka-63147600

On Sat, Apr 1, 2017 at 10:55 PM, Archie <anubhavnidhi1009@gmail.com> wrote:

> I have set up my kafka cluster in a network with 9.3 Gbps links. And am
> using the bin/kafka-producer-perf-test.sh script to test the throughput
> performance of kafka for a topic which has 1 partition.
>
> Right now I am only able to use 1.4 Gbps of network link, i.e. the script
> returns a throughput of 1.4 Gbps (179 MBps)
>
> My basic question is how can I increase the throughput of kafka to
> completely saturate the network?
>
> Thanks,
> Archie
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message