spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject InferFiltersFromConstraints logical optimization rule and Optimizer.defaultBatches?
Date Sun, 12 Apr 2020 12:53:45 GMT
Hi,

I'm curious why there is a need to include InferFiltersFromConstraints
logical optimization in operatorOptimizationRuleSet value [1] that seems to
be only to exclude it later [2]?

In other words, I think that simply removing InferFiltersFromConstraints
from operatorOptimizationRuleSet value [1] would make no change (except
removing a "dead code").

Does this make sense? Could I be missing something?

[1]
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala#L80
[2]
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala#L115

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
"The Internals Of" Online Books <https://books.japila.pl/>
Follow me on https://twitter.com/jaceklaskowski

<https://twitter.com/jaceklaskowski>

Mime
View raw message