kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Affan Syed <as...@an10.io>
Subject Re: [ANNOUNCE] New committer: Onur Karaman
Date Tue, 07 Nov 2017 07:00:48 GMT
Congrats Onur,

Can you also share the document where all known problems are listed; I am
assuming these bugs are still valid for the current stable release.


- Affan

On Mon, Nov 6, 2017 at 10:24 PM, Jun Rao <jun@confluent.io> wrote:

> Hi, everyone,
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Onur
> Karaman.
> Onur's most significant work is the improvement of Kafka controller, which
> is the brain of a Kafka cluster. Over time, we have accumulated quite a few
> correctness and performance issues in the controller. There have been
> attempts to fix controller issues in isolation, which would make the code
> base more complicated without a clear path of solving all problems. Onur is
> the one who took a holistic approach, by first documenting all known
> issues, writing down a new design, coming up with a plan to deliver the
> changes in phases and executing on it. At this point, Onur has completed
> the two most important phases: making the controller single threaded and
> changing the controller to use the async ZK api. The former fixed multiple
> deadlocks and race conditions. The latter significantly improved the
> performance when there are many partitions. Experimental results show that
> Onur's work reduced the controlled shutdown time by a factor of 100 times
> and the controller failover time by a factor of 3 times.
> Congratulations, Onur!
> Thanks,
> Jun (on behalf of the Apache Kafka PMC)

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message