kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harper Henn <harper.h...@datto.com>
Subject Re: Consumer rebalance not triggered
Date Mon, 17 Jun 2019 17:20:26 GMT
I just realized you wrote that your topics have only one partition each. My
response is not relevant, but the replies you received in a similar email
thread were.

On Sun, Jun 16, 2019, 1:46 PM Harper Henn <harper.henn@datto.com> wrote:

> Is there anything in Kafka server logs for your consumer group/group
> coordinator when new members join the group?
>
> I would expect partitions to be divided among members of the same consumer
> group.
>
> Does each consumer in the group have a client ID? This appears to be
> optional from what I've read, but just wondering.
>
> On Thu, Jun 13, 2019, 7:53 AM sunilverm@gmail.com <sunilverm@gmail.com>
> wrote:
>
>> I have 100 Kafka topics with one partition each.
>> I have started 10 instance of consumer and they use the same consumer
>> group id and i'm using subscribe by pattern.
>> I noticed that all the topic partition is assigned to the same consumer
>> and all other instances starve.
>> I expected that rebalance would be triggered and all instance would get
>> some topic partition.
>> Can someone confirm if this is expected behavior.
>>
>> Thanks,
>> Sunil
>>
>>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message