spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yash Datta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-5948) Support writing to partitioned table for the Parquet data source
Date Tue, 29 Dec 2015 10:18:49 GMT

    [ https://issues.apache.org/jira/browse/SPARK-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073755#comment-15073755
] 

Yash Datta commented on SPARK-5948:
-----------------------------------

oh i see, 
So does it mean that when using hive commands that use dynamic partitioning like :

insert verwrite table <tablename> partition (a, b)
select * from <sourcetable> 


spark will use this modified path ?

Thanks for the prompt reply

> Support writing to partitioned table for the Parquet data source
> ----------------------------------------------------------------
>
>                 Key: SPARK-5948
>                 URL: https://issues.apache.org/jira/browse/SPARK-5948
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Cheng Lian
>            Assignee: Michael Armbrust
>            Priority: Blocker
>             Fix For: 1.4.0
>
>
> In 1.3.0, we added support for reading partitioned tables declared in Hive metastore
for the Parquet data source. However, writing to partitioned tables is not supported yet.
This feature should probably built upon SPARK-5947.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message