spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "L. C. Hsieh (Jira)" <j...@apache.org>
Subject [jira] [Created] (SPARK-30112) Insert overwrite should be able to overwrite to same table under dynamic partition overwrite
Date Wed, 04 Dec 2019 00:18:00 GMT
L. C. Hsieh created SPARK-30112:
-----------------------------------

             Summary: Insert overwrite should be able to overwrite to same table under dynamic
partition overwrite
                 Key: SPARK-30112
                 URL: https://issues.apache.org/jira/browse/SPARK-30112
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: L. C. Hsieh
            Assignee: L. C. Hsieh


Currently, Insert overwrite cannot overwrite to same table even it is dynamic partition overwrite.
But for dynamic partition overwrite, we do not delete partition directories ahead. We write
to staging directories and move data to final partition directories. We should be able to
insert overwrite to same table under dynamic partition overwrite.





--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message