spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuanjian Li (Jira)" <>
Subject [jira] [Created] (SPARK-30125) Remove PostgreSQL dialect to reduce codebase maintenance cost
Date Wed, 04 Dec 2019 13:44:00 GMT
Yuanjian Li created SPARK-30125:

             Summary: Remove PostgreSQL dialect to reduce codebase maintenance cost
                 Key: SPARK-30125
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Yuanjian Li

As the discussion in [],
we need to remove PostgreSQL dialect form code base for several reasons:
1. The current approach makes the codebase complicated and hard to maintain.
2. Fully migrating PostgreSQL workloads to Spark SQL is not our focus for now.
Curently we have 3 features under PostgreSQL dialect:
1. SPARK-27931: when casting string to boolean, `t`, `tr`, `tru`, `yes`, .. are also allowed
as true string.
2. SPARK-29364: `date - date`  returns interval in Spark (SQL standard behavior), but return
int in PostgreSQL
3. SPARK-28395: `int / int` returns double in Spark, but returns int in PostgreSQL. (there
is no standard)

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message