kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wouter Bancken <wouter.banc...@aca-it.be>
Subject Kafka Consumer Offsets unavailable during rebalancing
Date Tue, 30 Jan 2018 20:04:23 GMT

I'm trying to write an external tool to monitor consumer lag on Apache

For this purpose, I'm using the kafka-consumer-groups tool to fetch the
consumer offsets.

When using this tool, partition assignments seem to be unavailable
temporarily during the creation of a new topic even if the consumer group
has no subscription on this new topic. This seems to match the documentation
saying *"Topic metadata changes which have no impact on subscriptions cause

However, when this occurs I'd expect the state of the consumer to be
"PreparingRebalance" or "AwaitingSync" but it is simply "Stable".

Is this a bug in the tooling or is there a different way to obtain the
correct offsets for a consumer group during a rebalance?

I'm using Kafka 10.2.1 but I haven't found any related issues in recent
Best regards,

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message