hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naveen Gangam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-21209) [Improvement] Exchange partitition to be metadata only change?
Date Mon, 04 Feb 2019 15:26:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-21209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759929#comment-16759929
] 

Naveen Gangam commented on HIVE-21209:
--------------------------------------

[~ashutoshc] [~pvary] [~thejas] A request for improvement from a real customer. Just wanted
to file the request so we could evaluate this. THanks

> [Improvement] Exchange partitition to be metadata only change?
> --------------------------------------------------------------
>
>                 Key: HIVE-21209
>                 URL: https://issues.apache.org/jira/browse/HIVE-21209
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>    Affects Versions: 2.1.1
>            Reporter: Naveen Gangam
>            Priority: Minor
>
> https://issues.apache.org/jira/browse/HIVE-14560
> Current implementation of the above jira is a metadata and a "copy" of the partition
data on the DFS. Could possibly take a long time to copy the data for large partition data
especially different storage clusters. When exchanging a partition from a HDFS to S3a or vice
versa the data is copied and this is client copy operation and it can be very slow if the
partition is very large.
> The customer would like the "exchange partition" operation to purely metadata.  I would
like to start a discussion on whether this improvement is to be made. Obviously, the current
behavior will be supported but and option for it to be a metadata operation only needs to
be evaluated.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message