kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sachin Mittal <sjmit...@gmail.com>
Subject Is there a way to control pipeline flow to downstream
Date Thu, 01 Dec 2016 09:19:31 GMT
Hi all,
Say I have a pipleline like this

topic.aggregateByKey( ...) => to downstream

Now for every message in topic it will call aggregateByKey and send it to

Is there a way to tell the pipeline that if it gets a certain message then
only push the current aggregation result to downstream.

Or I can do some configuration like until it has aggregated the result of n
messages don't push it to downstream.

Or any such logic can only be built in the downstream to check and decide
if it needs to process the current aggregation or not.


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message