hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-20707) Retention policies for partitioned tables
Date Tue, 09 Oct 2018 02:00:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-20707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasanth Jayachandran updated HIVE-20707:
-----------------------------------------
    Description: In current scenario, to add partitions for external tables to metastore,
MSCK REPAIR command has to be executed manually. To avoid this manual step, external tables
can be specified a table property (for retention policy) based on which a background metastore
thread can add/drop/sync partitions periodically. The retention policy can be generically
extended to managed tables as well (provided appropriate locks are obtained for adding and
dropping partitions)  (was: In current scenario, to add partitions for external tables to
metastore, MSCK REPAIR command has to be executed manually. To avoid this manual step, external
tables can be specified a table property based on which a background metastore thread can
add/drop/sync partitions periodically. )

> Retention policies for partitioned tables
> -----------------------------------------
>
>                 Key: HIVE-20707
>                 URL: https://issues.apache.org/jira/browse/HIVE-20707
>             Project: Hive
>          Issue Type: New Feature
>    Affects Versions: 4.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>         Attachments: HIVE-20707.1.patch
>
>
> In current scenario, to add partitions for external tables to metastore, MSCK REPAIR
command has to be executed manually. To avoid this manual step, external tables can be specified
a table property (for retention policy) based on which a background metastore thread can add/drop/sync
partitions periodically. The retention policy can be generically extended to managed tables
as well (provided appropriate locks are obtained for adding and dropping partitions)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message