spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cheng Lian (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-5948) Support writing to partitioned table for the Parquet data source
Date Tue, 29 Dec 2015 07:33:49 GMT

    [ https://issues.apache.org/jira/browse/SPARK-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073596#comment-15073596
] 

Cheng Lian commented on SPARK-5948:
-----------------------------------

It's the HadoopFsRelation based Parquet data source. HadoopFsRelation supports both reading
and writing partitioned tables.

> Support writing to partitioned table for the Parquet data source
> ----------------------------------------------------------------
>
>                 Key: SPARK-5948
>                 URL: https://issues.apache.org/jira/browse/SPARK-5948
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Cheng Lian
>            Assignee: Michael Armbrust
>            Priority: Blocker
>             Fix For: 1.4.0
>
>
> In 1.3.0, we added support for reading partitioned tables declared in Hive metastore
for the Parquet data source. However, writing to partitioned tables is not supported yet.
This feature should probably built upon SPARK-5947.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message