kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ismael Juma <ism...@juma.me.uk>
Subject Re: Broker shutdown slowdown between 1.1.0 and 2.3.1
Date Fri, 22 Nov 2019 15:57:36 GMT
Can you please file a JIRA?

Ismael

On Thu, Nov 21, 2019 at 3:52 PM Nicholas Feinberg <nicholas@liftoff.io>
wrote:

> I've been looking at upgrading my cluster from 1.1.0 to 2.3.1. While
> testing, I've noticed that shutting brokers down seems to take consistently
> longer on 2.3.1. Specifically, the process of 'creating snapshots' seems to
> take several times longer than it did on 1.1.0. On a small testing setup,
> the time needed to create snapshots and shut down goes from ~20s to ~120s;
> with production-scale data, it goes from ~2min to ~30min.
>
> To allow myself to roll back, I'm still using the 1.1 versions of the
> inter-broker protocol and the message format - is it possible that those
> could slow things down in 2.3.1? If not, any ideas what else could be at
> fault, or what I could do to narrow down the issue further?
>
> Thanks!
> -Nicholas
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message