spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuanjian Li (Jira)" <j...@apache.org>
Subject [jira] [Created] (SPARK-30125) Remove PostgreSQL dialect to reduce codebase maintenance cost
Date Wed, 04 Dec 2019 13:44:00 GMT
Yuanjian Li created SPARK-30125:
-----------------------------------

             Summary: Remove PostgreSQL dialect to reduce codebase maintenance cost
                 Key: SPARK-30125
                 URL: https://issues.apache.org/jira/browse/SPARK-30125
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Yuanjian Li


As the discussion in [http://apache-spark-developers-list.1001551.n3.nabble.com/DISCUSS-PostgreSQL-dialect-td28417.html],
we need to remove PostgreSQL dialect form code base for several reasons:
1. The current approach makes the codebase complicated and hard to maintain.
2. Fully migrating PostgreSQL workloads to Spark SQL is not our focus for now.
 
Curently we have 3 features under PostgreSQL dialect:
1. SPARK-27931: when casting string to boolean, `t`, `tr`, `tru`, `yes`, .. are also allowed
as true string.
2. SPARK-29364: `date - date`  returns interval in Spark (SQL standard behavior), but return
int in PostgreSQL
3. SPARK-28395: `int / int` returns double in Spark, but returns int in PostgreSQL. (there
is no standard)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message