kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Toni Cebrián <toni.cebr...@gmail.com>
Subject Routing modifications at runtime
Date Wed, 28 Jan 2015 20:10:06 GMT
Hi,

    I'm starting to weight different alternatives for data ingestion and
I'd like to know whether Kafka meets the problem I have.
    Say we have a set of devices each with its own MAC and then we receive
data in Kafka. There is a dictionary defined elsewhere that says each MAC
to which topic must publish. So I have basically 2 questions:
New MACs keep comming and the dictionary must be updated accordingly. How
could I change this Kafka behaviour during runtime?
A problem for the future. Say that dictionaries are so big that they don't
fit in memory. Are there any patterns for bookkeeping internal data
structures and how route to them?

T.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message