hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.
Date Fri, 20 May 2016 17:56:13 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Nauroth updated HADOOP-13145:
    Attachment: HADOOP-13145-branch-2.8.004.patch

Steve, thank you for catching the branch-2.8 problem and reverting.  Sorry I didn't catch
it myself earlier.

I'm attaching a branch-2.8 patch.  {{GenericTestUtils#getTestDir}} was introduced in your
HADOOP-12984 patch, targeted to 2.9.0.  That's a sizable patch, and I don't want to take on
a back-port right now.  Instead, this branch-2.8 patch goes back to the pre-HADOOP-12984 strategy
of individual tests reading the {{test.build.data}} property directly.

> In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.
> -------------------------------------------------------------------------------
>                 Key: HADOOP-13145
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13145
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>             Fix For: 2.8.0
>         Attachments: HADOOP-13145-branch-2.004.patch, HADOOP-13145-branch-2.8.004.patch,
HADOOP-13145.001.patch, HADOOP-13145.003.patch
> After DistCp copies a file, it calls {{getFileStatus}} to get the {{FileStatus}} from
the destination so that it can compare to the source and update metadata if necessary.  If
the DistCp command was run without the option to preserve metadata attributes, then this additional
{{getFileStatus}} call is wasteful.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message