kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Justin Miller <justin.mil...@protectwise.com>
Subject Contiguous Offsets on non-compacted topics
Date Tue, 23 Jan 2018 17:52:03 GMT
Greetings, 

We’ve seen a strange situation where-in the topic is not compacted but the offset numbers
inside the partition (#93) are not contiguous. This only happens once a day though, on a topic
with billions of messages per day.

next offset = 1786997223
next offset = 1786997224
next offset = 1786997226
next offset = 1786997227
next offset = 1786997228

I was wondering if this still holds with Kafka 0.10, 0.11, 1.0:	http://grokbase.com/t/kafka/users/12bpnexg1m/dumb-question-about-offsets
<http://grokbase.com/t/kafka/users/12bpnexg1m/dumb-question-about-offsets>

Specifically: “In Kafka 0.8, each message is assigned a monotonically increasing, contiguous
sequence number per partition,starting with 1.”

We’re on Kafka 1.0 with logs at version 0.9.0.0.

Thanks!
Justin
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message