hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "mahesh kumar behera (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HIVE-21213) Acid table bootstrap replication needs to handle directory created by compaction with txn id
Date Tue, 05 Feb 2019 05:08:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

mahesh kumar behera reassigned HIVE-21213:
------------------------------------------


> Acid table bootstrap replication needs to handle directory created by compaction with
txn id
> --------------------------------------------------------------------------------------------
>
>                 Key: HIVE-21213
>                 URL: https://issues.apache.org/jira/browse/HIVE-21213
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Hive, HiveServer2, repl
>            Reporter: mahesh kumar behera
>            Assignee: mahesh kumar behera
>            Priority: Major
>
> The current implementation of compaction makes use of compaction to use the txn id in
the directory name. This is used to isolate the queries from reading the directory until compaction
has finished. In case of replication, the directory can not be copied as the txn list at target
may be different from source. So conversion logic is required to create a new directory with
valid txn at target and dump the data to the newly created directory.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message