kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harper Henn <harper.h...@datto.com>
Subject Re: Optimising Time For Leader Election
Date Thu, 06 Dec 2018 17:49:45 GMT
Hi Mark,

If a broker fails and you want to elect a new leader as quickly as
possible, you could tweak zookeeper.session.timeout.ms in the kafka broker
configuration. According to the documentation: "If the consumer fails to
heartbeat to ZooKeeper for this period of time it is considered dead and a
rebalance will occur."


I think making zookeeper.session.timeout.ms smaller will result in faster
detection of a dead node, but the downside is that a leader election might
get triggered by network blips or other cases where your broker is not
actually dead.


On Thu, Dec 6, 2018 at 9:11 AM Mark Anderson <manderson23@gmail.com> wrote:

> Hi,
> I'm currently testing how Kafka reacts in cases of broker failure due to
> process failure or network timeout.
> I'd like to have the election of a new leader for a topic partition happen
> as quickly as possible but it is unclear from the documentation or broker
> configuration what the key parameters are to tune to make this possible.
> Does anyone have any pointers? Or are there any guides online?
> Thanks,
> Mark

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message