[ https://issues.apache.org/jira/browse/HIVE-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated HIVE-23499:
------------------------------------
Description:
"{{hive.repl.dump.metadata.only=true"}} is not currently honored during "{{repl load"}}. Currently,
it ends up copying all files even if this option is specified in "repl load". E.g
{noformat}
repl load airline_ontime_orc into another_airline_ontime_orc with ('hive.repl.rootdir'='s3a://blah/',
'hive.repl.dump.metadata.only'='true'); {noformat}
Alternatively, we can use {{hive.repl.dump.skip.immutable.data.copy}} and skip the load ack
file. This would enable users to reuse immutable repl dumps.
was:
"{{hive.repl.dump.metadata.only=true"}} is not currently honored during "{{repl load"}}. Currently,
it ends up copying all files even if this option is specified in "repl load". E.g
{noformat}
repl load airline_ontime_orc into another_airline_ontime_orc with ('hive.repl.rootdir'='s3a://blah/',
'hive.repl.dump.metadata.only'='true'); {noformat}
Alternatively, we can use
> REPL: Immutable repl dumps should be reusable across multiple repl loads
> ------------------------------------------------------------------------
>
> Key: HIVE-23499
> URL: https://issues.apache.org/jira/browse/HIVE-23499
> Project: Hive
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Priority: Major
> Attachments: HIVE-23499.1.patch, HIVE-23499.2.patch
>
>
> "{{hive.repl.dump.metadata.only=true"}} is not currently honored during "{{repl load"}}.
Currently, it ends up copying all files even if this option is specified in "repl load".
E.g
> {noformat}
> repl load airline_ontime_orc into another_airline_ontime_orc with ('hive.repl.rootdir'='s3a://blah/',
'hive.repl.dump.metadata.only'='true'); {noformat}
> Alternatively, we can use {{hive.repl.dump.skip.immutable.data.copy}} and skip the load
ack file. This would enable users to reuse immutable repl dumps.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
|