spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raghavendra Pandey <>
Subject Multiple queries on same stream
Date Wed, 09 Aug 2017 05:05:38 GMT
I am using structured streaming to evaluate multiple rules on same running
I have two options to do that. One is to use forEach and evaluate all the
rules on the row..
The other option is to express rules in spark sql dsl and run multiple
I was wondering if option 1 will result in better performance even though I
can get catalyst optimization in option 2.


View raw message