kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Store a single message across mutiple topics
Date Sat, 15 Sep 2012 05:46:49 GMT
Kafka supports multi-subscription. You can put the events in a single topic
and have different consumer groups consume the same topic. Each consumer
group maintains its own offsets.

Thanks,

Jun

On Fri, Sep 14, 2012 at 11:14 AM, Rohit Chandra <
rohitchandra.satya@gmail.com> wrote:

> >
> > Hi,
> >
> > In our application we are using Kafka for activity stream. We wanted to
> > know if there is a way in Kafka to send a single message to multiple
> topics
> > and store it only once, then later consume these messages from these
> topics
> > individually and maintain  their offsets separately.
> >
> > Taking the example of facebook or LinkedIn, when someone updates on his
> > page then his respective connection should also get this message. If
> using
> > Kafka we maintain  a stream of messages for each user, then we want to
> have
> > one topic per user, but if the message are also duplicated then it will
> be
> > huge impact on the resources.
> >
>
>    Thanks !
>
> Best Regards,
> Rohit Chandra
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message