spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paolo Platter <>
Subject Structured Streaming & Query Planning
Date Thu, 14 Mar 2019 15:50:59 GMT
Hi All,

I would like to understand why in a streaming query ( that should not be able to change its
behaviour along iterations ) there is a queryPlanning-Duration effort ( in my case is 33%
of trigger interval ) at every schedule. I don’t uderstand  why this is needed and if it
is possible to disable or cache it.



Paolo Platter
Web Site:<>

View raw message