kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hans Jespersen <h...@confluent.io>
Subject Re: Is there expiration for committed Offset in the partition
Date Fri, 01 Jun 2018 08:20:20 GMT
You should just recommit the same offsets sooner than every 24 hours (or whatever your commit
topic retention period is set to). The expiry of offsets is based on the timestamp of the
commits.

-hans

> On Jun 1, 2018, at 1:03 AM, Dinesh Subramanian <dsubramanian@apptivo.co.in> wrote:
> 
> Hi,
> 
> Facing duplication in below scenario
> 
> Last commit is happened in 3 days back in the consumer, after that no
> messages produced in the topic. so no commits..
> so after 3 days am stopping and restarting the consumer..  this time i
> faced duplication issue in the consumer as i have this consumer
> property "*auto.offset.reset
> = earliest*", It is consumed again from the beginning.. any helps will be
> appreciated.
> 
> *Thanks & Regards,*
> 
> *Dinesh S*

Mime
View raw message