spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hemalatha A <hemalatha.amru...@googlemail.com>
Subject Fail a batch in Spark Streaming forcefully based on business rules
Date Wed, 27 Jul 2016 05:12:33 GMT
Hello,

I have a uescase where in, I have  to fail certain batches in my streaming
batches, based on my application specific business rules.
Ex: If in a batch of 2 seconds, I don't receive 100 message, I should fail
the batch and move on.

How to achieve this behavior?

-- 


Regards
Hemalatha

Mime
View raw message