kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Boyang Chen <reluctanthero...@gmail.com>
Subject Re: dynamic produce and consume new topics
Date Fri, 12 Jun 2020 16:29:46 GMT
Hey AJ,

you should be able to make the subscribed topics and output topics dynamic
configs for Consumer and Producer. If you need to create new topics on
runtime, there is some broker side setting you could use to allow topic
creation based of produced records:
https://stackoverflow.com/questions/36441768/how-to-create-topics-in-apache-kafka

On Fri, Jun 12, 2020 at 9:01 AM AJ Chen <canovaj@gmail.com> wrote:

> I'm working on a data streaming system where users will publish to
> different new topics and subscribe to different new topics without
> restarting the system. A large number of topics will be created over time.
> Uer will choose different new topics to publish and subscribe dynamically
> at runtime. Can someone share good design or practice to implement such
> dynamic topic handling? Links to sample code will be very helpful.
>
> Thanks,
> aj
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message