kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manoj Khangaonkar <khangaon...@gmail.com>
Subject KafkaConsumer pause method not working as expected
Date Wed, 01 Aug 2018 00:56:56 GMT

I am implementing flow control by

(1) using the pause(partitions) method on the consumer to stop
consumer.poll from returning messages.

(2) using the resume(partitions) method on the consumer to let
consumer.poll return messages

This works well for a while. Several sets of  pause-resume work as expected.

But after a while I am seeing that the paused consumer starts returning
messages WITHOUT my code calling resume.

There are no changes in the partitions assigned to consumer. I know this
because I logs the assigned partitions after every consumer.poll(...). That
should rule out a rebalance.

Is there something that I am missing here ?

Is there something more required to pause a consumer from retrieving
message ?



  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message