kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Archie <anubhavnidhi1...@gmail.com>
Subject Increase speed of replica fetch in kafka?
Date Fri, 05 May 2017 19:59:18 GMT
Is there anyway I can speed up the rate at which the slave replicas will
fetch data from master?

I am using bin/kafka-producer-perf-test.sh to test the throughput of my
producer. And I have set a client quota of 50 MBps. Now without any
replicas I am getting throughput ~ 50MBps but when replication factor is
set to 3, it reduces to ~30 MBps.

There is no other traffic in the network so I am not sure why things are
slowing down. Is there some parameter like
replica.socket.receive.buffer.bytes, replica.fetch.min.bytes that needs to
be tuned to achieve high throughput? How can I speed up my replicas?

Thanks,
Archie

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message