spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wenchen Fan (JIRA)" <>
Subject [jira] [Commented] (SPARK-19154) support read and overwrite a same table
Date Wed, 11 Jan 2017 05:17:58 GMT


Wenchen Fan commented on SPARK-19154:

it turns out that we still remove all the files before overwrite, and there is no easy way
to support this feature unless we overwrite data to a temp directory first. I'm closing this
ticket as "later".

> support read and overwrite a same table
> ---------------------------------------
>                 Key: SPARK-19154
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Wenchen Fan
> In SPARK-5746 , we forbid users to read and overwrite a same table. It seems like we
don't need this limitation now, we can remove the check and add regression tests. We may need
to take care of partitioned table though.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message