kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ewen Cheslack-Postava <e...@confluent.io>
Subject Re: Kafka does not preserve an offset on topic.
Date Sun, 24 Jul 2016 00:40:55 GMT
The parameter you want is AUTO_OFFSET_RESET_CONFIG. If setting that to
latest isn't working, can you include some code that reproduces the issue?

-Ewen

On Wed, Jul 6, 2016 at 6:21 AM, Pawel Huszcza <phuszcza@mandaracapital.com>
wrote:

> Hello,
>
> I tried every different property I can think of - I have set
> ConsumerConfig.ENABLE_AUTO_COMMIT_CONFIG = true;
> ConsumerConfig.AUTO_COMMIT_INTERVAL_MS_CONFIG = 1000, but I have also tried
> with many different values
> And still every time I start my consumer - I am receiving all the messages
> ever sent to the given topic - it is every time the same consumer group;
> ConsumerConfig.AUTO_OFFSET_RESET_CONFIG = "latest" but I also tried with
> "earliest" (just for luck). What is the proper configuration to get it to
> work in such a way, that every time I start my consumer - it will process
> only the new messages not all of them?
>
> Kind Regards,
> Pawel Jan Huszcza
>
>


-- 
Thanks,
Ewen

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message