hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16101) Use lighter-weight alternatives to innerGetFileStatus where possible
Date Wed, 24 Apr 2019 13:48:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16825160#comment-16825160

Steve Loughran commented on HADOOP-16101:

Update, I think the new openFile() builder should take a withSource(FileStatus) param. If
you already have the file status: no need to repeat yourself. We can do the same for rename.

> Use lighter-weight alternatives to innerGetFileStatus where possible
> --------------------------------------------------------------------
>                 Key: HADOOP-16101
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16101
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Sean Mackrory
>            Priority: Major
> Discussion in HADOOP-15999 highlighted the heaviness of a full innerGetFileStatus call,
where many usages of it may need a lighter weight fileExists, etc. Let's investigate usage
of innerGetFileStatus and slim it down where possible.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message