kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Aley <Thomas.A...@ibm.com>
Subject Broker Interceptors
Date Mon, 02 Dec 2019 09:40:55 GMT
Hi Kafka community,

I am hoping to get some feedback and thoughts about broker interceptors.

KIP-42 Added Producer and Consumer interceptors which have provided Kafka 
users the ability to collect client side metrics and trace the path of 
individual messages end-to-end.

This KIP also mentioned "Adding message interceptor on the broker makes a 
lot of sense, and will add more detail to monitoring. However, the 
proposal is to do it later in a separate KIP".

One of the motivations for leading with client interceptors was to gain 
experience and see how useable they are before tackling the server side 
implementation which would ultimately "allow us to have a more 
complete/detailed message monitoring".

Broker interceptors could also provide more value than just more complete 
and detailed monitoring such as server side schema validation, so I am 
curious to learn if anyone in the community has progressed this work; has 
ideas about other potential server side interceptor uses or has actually 
implemented something similar.


Tom Aley
Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message