kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chandra R <mybaywo...@gmail.com>
Subject Re: kafka 1:N message delivery pattern
Date Fri, 09 Sep 2011 21:26:07 GMT
Thank you all,

I get it now.
I was trying thinking in terms of RabbitMQ's fanout exchange.

So from what I understand it will be difficult to implement if number of
users are in millions (or in our case grows to millions),
as we need a topic for each user.

I wish there was an option thought :)

reagrds,

Chandra



On Fri, Sep 9, 2011 at 4:04 PM, Jun Rao <junrao@gmail.com> wrote:

> Chandra,
>
> Let me see if I understand what you want to do. There is one topic per user
> (which stores all tweets posted by this user). Each follower consumes the
> topics corresponding to the users he follows. Conceptually, this works. The
> question is the number of topics. Currently, Kafka is not suitable for
> millions of topics.
>
> Jun
>
> On Fri, Sep 9, 2011 at 1:40 PM, Chandra R <mybayworkz@gmail.com> wrote:
>
> > Hello All,
> >
> > I am trying to understand the Kafka 1:N pattern.
> > I am trying to understand it in terms of a twitter like app.
> >
> > For every user there will be 1 Producer. Each follower will be in its own
> > consumer group and there will be a Broker which will connect Producer to
> > Consumer groups.
> >
> > Am I getting it right ?
> >
> > Thanks. Any advice would be appreciated.
> >
> > regards
> >
> > Chandra R
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message