spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Natalie Ruiz <Natalie.R...@microsoft.com.INVALID>
Subject Structured Streaming: How to add a listener for when a batch is complete
Date Tue, 03 Sep 2019 22:25:47 GMT
Hello all,

I'm a beginner, new to Spark and wanted to know if there was an equivalent to Spark Streaming's
StreamingListenerBatchCompleted in Structured Streaming? I want to add a listener for when
a batch is complete but the documentation and examples I find are for Spark Streaming and
not Structured Streaming and registering it to a StreamingContext, which from my understanding
is just for Spark Streaming

Thanks!

Mime
View raw message