kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias J. Sax" <matth...@confluent.io>
Subject Re: Kafka commit interval
Date Fri, 19 Oct 2018 18:25:33 GMT
There is not upper limit.

And yes, you are right about rebalancing. This would be an issue and
yes, you can use the rebalance listener to address it (it's the purpose
of the rebalance listener to be used for cases like this).


On 10/16/18 2:19 PM, pradeep s wrote:
> Hi,
> I have a usecase to stream messages from Kafka and buffer it in memory till
> a message count is reached and then write these to output file . I am using
> manual commit . I have a question on whats the maximum time i can wait
> after consuming the message and till we commit back to Kafka . Is there a
> upper limit for this ? Is consumer rebalance the only issue while waiting
> long periods, then can i write the contents using a rebalance listener and
> commit at that point .
> Thanks
> Pradeep

View raw message