kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adam Kunicki <a...@streamsets.com>
Subject Kafka Committed Offset Behavior off by 1
Date Mon, 01 Feb 2016 21:35:02 GMT

I've been noticing that a restarted consumer in 0.9 will start consuming
from the last committed offset (inclusive). This means that any restarted
consumer will get the last read (and committed) message causing a duplicate
each time the consumer is restarted from the same position if there have
been no new messages.

this seems like that is the intended behavior.

Can anyone confirm this? If this is the case how are we expected to handle
these duplicated messages?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message