hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (HIVE-21281) Repl checkpointing doesn't work when retry bootstrap load with partitions of external tables.
Date Mon, 18 Feb 2019 13:23:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21281?focusedWorklogId=200052&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-200052
]

ASF GitHub Bot logged work on HIVE-21281:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 18/Feb/19 13:22
            Start Date: 18/Feb/19 13:22
    Worklog Time Spent: 10m 
      Work Description: maheshk114 commented on pull request #539: HIVE-21281: Repl checkpointing
doesn't work while retry bootstrap load with partitions of external tables.
URL: https://github.com/apache/hive/pull/539#discussion_r257690116
 
 

 ##########
 File path: itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/parse/WarehouseInstance.java
 ##########
 @@ -361,6 +362,32 @@ private void printOutput() throws IOException {
     }
   }
 
+  private void verifyIfCkptSet(Map<String, String> props, String dumpDir) {
+    assertTrue(props.containsKey(ReplUtils.REPL_CHECKPOINT_KEY));
 
 Review comment:
    assertTrue(props.containsKey(ReplUtils.REPL_CHECKPOINT_KEY)) is redundant
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 200052)
    Time Spent: 20m  (was: 10m)

> Repl checkpointing doesn't work when retry bootstrap load with partitions of external
tables.
> ---------------------------------------------------------------------------------------------
>
>                 Key: HIVE-21281
>                 URL: https://issues.apache.org/jira/browse/HIVE-21281
>             Project: Hive
>          Issue Type: Bug
>          Components: repl
>    Affects Versions: 4.0.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>            Priority: Major
>              Labels: DR, Replication, pull-request-available
>         Attachments: HIVE-21281.01.patch
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Repl checkpoint feature optimises the retry logic of bootstrap repl load by skipping
the properly loaded tables and partitions. In case of retry of bootstrap load with external
tables having partitions, the checkpoint doesn't work and load partitions always.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message