kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ali Akhtar <ali.rac...@gmail.com>
Subject Re: New Idea for Kafka multiple consumers running parallel.
Date Tue, 04 Oct 2016 12:33:59 GMT
You may be able to control the starting offset,  but if you try to control
which instance gets offset 4.. you'll lose all benefits of parallelism.

On 4 Oct 2016 3:02 pm, "Kaushil Rambhia/ MUM/CORP/ ENGINEERING" <
kaushil.r@pepperfry.com> wrote:

> Hi guys,
> i am using apache kafka with phprd kafka, i want to know how can i use
> multiple Kafka consumers on same partition from different groups to consume
> message parallel, say if consumer are c1,c2,c3 consuming single partition
> 0,
> than if c1 is consuming from 0 offset than c2 should start from 1 and c3
> from 2 and if any new consumer comes up it should start from latest offset
> which is yet to be consumed by any consumer.
>
> --
> Regards,
> Kaushil Rambhia
>
> --
>
>
>
> DISCLAIMER: The contents of this message may be legally privileged and
> confidential and are for the use of the intended recipient(s) only. It
> should not be read, copied and used by anyone other than the intended
> recipient(s). If you have received this message in error, please
> immediately notify the sender, preserve its confidentiality and delete it.
> Before opening any attachments please check them for viruses and defects.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message