kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wouter Bancken <wouter.banc...@aca-it.be>
Subject Kafka Consumer Offsets unavailable during rebalancing
Date Tue, 30 Jan 2018 20:04:23 GMT
Hi,

I'm trying to write an external tool to monitor consumer lag on Apache
Kafka.

For this purpose, I'm using the kafka-consumer-groups tool to fetch the
consumer offsets.

When using this tool, partition assignments seem to be unavailable
temporarily during the creation of a new topic even if the consumer group
has no subscription on this new topic. This seems to match the documentation
<https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Client-side+Assignment+Proposal>
saying *"Topic metadata changes which have no impact on subscriptions cause
resync"*.

However, when this occurs I'd expect the state of the consumer to be
"PreparingRebalance" or "AwaitingSync" but it is simply "Stable".

Is this a bug in the tooling or is there a different way to obtain the
correct offsets for a consumer group during a rebalance?

I'm using Kafka 10.2.1 but I haven't found any related issues in recent
changelogs.
Best regards,
Wouter

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message