spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dongjoon Hyun (Jira)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-28573) Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table
Date Mon, 19 Aug 2019 22:08:01 GMT

     [ https://issues.apache.org/jira/browse/SPARK-28573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dongjoon Hyun updated SPARK-28573:
----------------------------------
    Affects Version/s:     (was: 2.4.3)
                           (was: 2.3.3)
                       3.0.0

> Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table
> ----------------------------------------------------------------------------------------
>
>                 Key: SPARK-28573
>                 URL: https://issues.apache.org/jira/browse/SPARK-28573
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Xianjin YE
>            Priority: Major
>
> Currently we don't translate InsertInto(HiveTableRelation) to DataSource insertion when
partitioned table is involved, the reason is that, quote from the comments:
> {quote}// Inserting into partitioned table is not supported in Parquet/Orc data source
(yet).
> {quote}
>  
> which doesn't hold any more. Since datasource table dynamic partition insert now supports 
> dynamic mode (SPARK-20236). I think it's worthy to translate InsertIntoTable(HiveTableRelation)
to datasource table.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message