kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject Re: is there a way to make sure two consumers receive the same message from the broker?
Date Sat, 05 Nov 2016 23:31:58 GMT
I am new to Kafka and reading this statement "write consumer 1 and consumer
2 to share a common external offset storage" I can interpret it many ways
but my best guess is as follows.

Are you saying write the current offset of each consumer to a common
external storage?


On Sat, Nov 5, 2016 at 4:15 PM, kant kodali <kanth909@gmail.com> wrote:

> Hi Hans,
>
> What do you mean by "write consumer 1 and consumer 2 to share a common
> external offset storage" ? can you please elaborate a bit more.
>
> Thanks!
>
> On Sat, Nov 5, 2016 at 4:00 PM, Hans Jespersen <hans@confluent.io> wrote:
>
>> There is no built in mechanism to do this in Apache Kafka but if you can
>> write consumer 1 and consumer 2 to share a common external offset storage
>> then you may be able to build the functionality you seek.
>>
>> -hans
>>
>>
>>
>> > On Nov 5, 2016, at 3:55 PM, kant kodali <kanth909@gmail.com> wrote:
>> >
>> > Sorry there is a typo. here is a restatement.
>> >
>> > Is there a way to make sure two consumers receive the same message from
>> the
>> > kafka broker in a atomic way? such that if consumer 1 gets a message
>> > consumer 2 should also get that message and if  consumer 1 fails for
>> > whatever reason consumer 2 should also rollback to previous offset (to
>> the
>> > same offset as consumer 1) or invalidate or something like that. is that
>> > possible?
>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message