kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From pradeep s <sreekumar.prad...@gmail.com>
Subject Kafka commit interval
Date Tue, 16 Oct 2018 21:19:08 GMT
I have a usecase to stream messages from Kafka and buffer it in memory till
a message count is reached and then write these to output file . I am using
manual commit . I have a question on whats the maximum time i can wait
after consuming the message and till we commit back to Kafka . Is there a
upper limit for this ? Is consumer rebalance the only issue while waiting
long periods, then can i write the contents using a rebalance listener and
commit at that point .

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message