hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16255) ChecksumFS.Make FileSystem.rename(path, path, options) doesn't rename checksum
Date Fri, 23 Aug 2019 18:08:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914524#comment-16914524

Steve Loughran commented on HADOOP-16255:

I see your issue. 
# It should just be matter of overriding the rename/3 call and having it move the CRC tool;
this is good to preserve the checksum too.
# patches with tests welcome...
# we're never going to do another 2.7.x release so saying it is affected isn't going to make
anyone care. I've tagged 2.8.5 as affected too
# now. can you upgrade spark's dependencies? please? 

> ChecksumFS.Make FileSystem.rename(path, path, options) doesn't rename checksum
> ------------------------------------------------------------------------------
>                 Key: HADOOP-16255
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16255
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.8.5, 3.1.2
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
> ChecksumFS doesn't override FilterFS rename/3, so doesn't rename the checksum with the
> As a result, if a file is renamed over an existing file using rename(src, dest, OVERWRITE)
the renamed file will be considered to have an invalid checksum -the old one is picked up

This message was sent by Atlassian Jira

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message