hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-23499) REPL: repl load should honor "hive.repl.dump.metadata.only=true"
Date Thu, 11 Jun 2020 04:55:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17132917#comment-17132917
] 

Rajesh Balamohan commented on HIVE-23499:
-----------------------------------------

Given that we have {{hive.repl.dump.skip.immutable.data.copy}}, we can use it in dump side
as well. In such cases, same dump can be used multiple times. Need to ensure that "load complete
ack" file is not created in such cases. I will upload .2 version shortly.

> REPL: repl load should honor "hive.repl.dump.metadata.only=true"
> ----------------------------------------------------------------
>
>                 Key: HIVE-23499
>                 URL: https://issues.apache.org/jira/browse/HIVE-23499
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Major
>         Attachments: HIVE-23499.1.patch
>
>
> "{{hive.repl.dump.metadata.only=true"}} is not currently honored during "{{repl load"}}.
Currently, it ends up copying all files even if this option is specified in "repl load". 
E.g
> {noformat}
> repl load airline_ontime_orc into another_airline_ontime_orc with ('hive.repl.rootdir'='s3a://blah/',
'hive.repl.dump.metadata.only'='true'); {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message