hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naveen Gangam (JIRA)" <>
Subject [jira] [Commented] (HIVE-21209) [Improvement] Exchange partitition to be metadata only change?
Date Mon, 04 Feb 2019 15:26:00 GMT


Naveen Gangam commented on HIVE-21209:

[~ashutoshc] [~pvary] [~thejas] A request for improvement from a real customer. Just wanted
to file the request so we could evaluate this. THanks

> [Improvement] Exchange partitition to be metadata only change?
> --------------------------------------------------------------
>                 Key: HIVE-21209
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>    Affects Versions: 2.1.1
>            Reporter: Naveen Gangam
>            Priority: Minor
> Current implementation of the above jira is a metadata and a "copy" of the partition
data on the DFS. Could possibly take a long time to copy the data for large partition data
especially different storage clusters. When exchanging a partition from a HDFS to S3a or vice
versa the data is copied and this is client copy operation and it can be very slow if the
partition is very large.
> The customer would like the "exchange partition" operation to purely metadata.  I would
like to start a discussion on whether this improvement is to be made. Obviously, the current
behavior will be supported but and option for it to be a metadata operation only needs to
be evaluated.

This message was sent by Atlassian JIRA

View raw message