kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Helin Xiang <xkee...@gmail.com>
Subject In what condition does getoffsetbefore (latest) not return latest offset?
Date Mon, 08 Dec 2014 10:59:13 GMT
Hi,

We have currently upgraded our kafka cluster from 0.7.2 to 0.8.1.1.

In one of our application, we want to get all partitions' latest offsets,
so we use getoffsetbefore java API (latest).

We believe at some time, 1 of the partition's latest offset we got is much
smaller than its real latest offset,(we saw in the application's log that
the partition's offset is much smaller than other partitions'). Since the
real data file of that partition was already deleted, we cannot prove our
guess, but we found some clue in the kafka's application log which helps us
to conclude that the partition's latest offset at that moment did have a
much larger number.

some additional useful information: the partition have 1 additional
replica(follower), and at that time, it was not synced with the leader
partition(far away behind the leader).

Does any one have the same issue? In what condition could lead to this
situation?

Thanks.

-- 


*Best Regards向河林*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message