phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Geoffrey Jacoby (Jira)" <j...@apache.org>
Subject [jira] [Updated] (PHOENIX-5645) GlobalIndexChecker should prevent compaction from purging very recently deleted cells
Date Fri, 10 Jan 2020 06:24:00 GMT

     [ https://issues.apache.org/jira/browse/PHOENIX-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Geoffrey Jacoby updated PHOENIX-5645:
-------------------------------------
    Attachment: PHOENIX-5645-4.x-HBase-1.5-v2.patch

> GlobalIndexChecker should prevent compaction from purging very recently deleted cells
> -------------------------------------------------------------------------------------
>
>                 Key: PHOENIX-5645
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-5645
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Geoffrey Jacoby
>            Assignee: Geoffrey Jacoby
>            Priority: Major
>         Attachments: PHOENIX-5645-4.x-HBase-1.5-v2.patch, PHOENIX-5645-4.x-HBase-1.5.patch
>
>          Time Spent: 3h 40m
>  Remaining Estimate: 0h
>
> IndexTool rebuilds and index scrutiny can both give strange, incorrect results if a major
compaction occurs in the middle of their run. In the rebuild case, it's because we're rewriting
"history" on the index at the same time that compaction is rewriting "history" by purging
deleted and expired cells. 
> In the case of scrutiny, it's because it does an SCN-based lookback, and if versions
are purged on the index before their equivalent data table rows, you can get false errors.

> Since in the new indexing path we already have a coprocessor on each index, it should
override the compaction hook to shield rows newer than some configurable age from being purged
during a major compaction.
> In the future, this should be contributed as a general feature to HBase for arbitrary
tables. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message