spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dongjoon Hyun (Jira)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-29886) Add support for Spark style HashDistribution and Partitioning to V2 Datasource
Date Mon, 16 Mar 2020 22:53:03 GMT

     [ https://issues.apache.org/jira/browse/SPARK-29886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dongjoon Hyun updated SPARK-29886:
----------------------------------
    Affects Version/s:     (was: 3.0.0)
                       3.1.0

> Add support for Spark style HashDistribution and Partitioning to V2 Datasource
> ------------------------------------------------------------------------------
>
>                 Key: SPARK-29886
>                 URL: https://issues.apache.org/jira/browse/SPARK-29886
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.0
>            Reporter: Andrew K Long
>            Priority: Major
>
> Currently a v2 datasource does not have the ability specify that its Distribution iscompatible
with sparks HashClusteredDistribution.  We need to add the appropriate class in the interface
and add support in DataSourcePartitioning so that EnsureRequirements is aware of the tables
partitioning.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message