kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Girish Aher <girisha...@gmail.com>
Subject Re: Increase speed of replica fetch in kafka?
Date Fri, 05 May 2017 21:39:14 GMT
Have you tried increasing num.replica.fetchers on your brokers?

On Fri, May 5, 2017 at 12:59 PM, Archie <anubhavnidhi1009@gmail.com> wrote:

> Is there anyway I can speed up the rate at which the slave replicas will
> fetch data from master?
>
> I am using bin/kafka-producer-perf-test.sh to test the throughput of my
> producer. And I have set a client quota of 50 MBps. Now without any
> replicas I am getting throughput ~ 50MBps but when replication factor is
> set to 3, it reduces to ~30 MBps.
>
> There is no other traffic in the network so I am not sure why things are
> slowing down. Is there some parameter like
> replica.socket.receive.buffer.bytes, replica.fetch.min.bytes that needs to
> be tuned to achieve high throughput? How can I speed up my replicas?
>
> Thanks,
> Archie
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message