spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Kruszewski (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-9843) Catalyst: Allow adding custom optimizers
Date Tue, 11 Aug 2015 20:28:45 GMT
Robert Kruszewski created SPARK-9843:
----------------------------------------

             Summary: Catalyst: Allow adding custom optimizers
                 Key: SPARK-9843
                 URL: https://issues.apache.org/jira/browse/SPARK-9843
             Project: Spark
          Issue Type: New Feature
          Components: SQL
    Affects Versions: 1.4.1
            Reporter: Robert Kruszewski


Currently there's only option to plug into query planning. This provides limited capability
for optimizing queries.

Allowing specifying custom optimizers would allow applications that make use of spark sql
tune their workflows. One example would be inserting repartitions into query plan which isn't
generally applicable but if you know range of possible queries you can do that on the backend.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message