kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Roesler <j...@confluent.io>
Subject Re: How to be notified by Kafka stream during partitions rebalancing
Date Tue, 09 Apr 2019 16:31:19 GMT
Hi Pierre,

If you're using a Processor (or Transformer), you might be able to use the
`close` method for this purpose. Streams invokes `close` on the Processor
when it suspends the task at the start of the rebalance, when the
partitions are revoked. (It invokes `init` once the rebalance is complete
and the partition is assigned again.)

Does this help?

Thanks,
-John

On Thu, Apr 4, 2019 at 6:39 AM Pierre Coquentin <pierre.coquentin@gmail.com>
wrote:

> thanks :)
>
> On Thu, Apr 4, 2019 at 11:11 AM Dimitry Lvovsky <dlvovsky@gmail.com>
> wrote:
>
> > You can detect state changes in your streaming app by implementing
> > KafkaStreams.StateListener,
> > and then registering that with your KafkaStreeams Object e.g new
> > KafkaStreams(...).setStateListener();
> >
> > Hope this helps.
> >
> > On Thu, Apr 4, 2019 at 10:52 AM Pierre Coquentin <
> > pierre.coquentin@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > We have a cache in a processor based on assigned partitions and when
> > Kafka
> > > revokes those partitions we would like to flush the cache. The method
> > > punctuate is neet to do that except that as a client of Kafka stream, I
> > am
> > > not notified during a revoke.
> > > I found the same question on StackOverflow
> > >
> > >
> >
> https://stackoverflow.com/questions/51626089/kafka-streams-consumerrebalancelistener-implementation
> > > but
> > > nothing in Jira. Is it plan to develop this kind of feature? Or
> perhaps I
> > > missed something?
> > > Regards,
> > >
> > > Pierre
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message