kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Toni Cebrián <toni.cebr...@gmail.com>
Subject Routing modifications at runtime
Date Wed, 28 Jan 2015 20:10:06 GMT

    I'm starting to weight different alternatives for data ingestion and
I'd like to know whether Kafka meets the problem I have.
    Say we have a set of devices each with its own MAC and then we receive
data in Kafka. There is a dictionary defined elsewhere that says each MAC
to which topic must publish. So I have basically 2 questions:
New MACs keep comming and the dictionary must be updated accordingly. How
could I change this Kafka behaviour during runtime?
A problem for the future. Say that dictionaries are so big that they don't
fit in memory. Are there any patterns for bookkeeping internal data
structures and how route to them?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message