hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13162) Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs
Date Wed, 18 May 2016 16:17:12 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289227#comment-15289227

Rajesh Balamohan commented on HADOOP-13162:

It should be possible to save one more additional FileStatus call in deleteUnnecessaryFakeDirectories
in S3AFileSystem. Will check on adding that change along with this patch.

> Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs
> -----------------------------------------------------------------------
>                 Key: HADOOP-13162
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13162
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>            Reporter: Rajesh Balamohan
>            Priority: Minor
>         Attachments: HADOOP-13162-branch-2-002.patch, HADOOP-13162.001.patch
> getFileStatus is relatively expensive call and mkdirs invokes it multiple times depending
on how deep the directory structure is. It would be good to reduce the number of getFileStatus
calls in such cases.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message