hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (Jira)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-16665) Filesystems to be closed if they failed during initialize()
Date Mon, 21 Oct 2019 11:57:00 GMT
Steve Loughran created HADOOP-16665:

             Summary: Filesystems to be closed if they failed during initialize()
                 Key: HADOOP-16665
                 URL: https://issues.apache.org/jira/browse/HADOOP-16665
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs, fs/s3
    Affects Versions: 3.1.3, 3.2.1
            Reporter: Steve Loughran

We seen this with S3A but it is likely to apply to the other file systems too:

If the file system raises an exception during initialize() then it is not close()'d. Any resources
threads etc created during initialisation may be leaked.

I'm going to fix S3A to clean up internally, but the FileSystem get() and newInstance() methods
should also catch and close if an IOE or RTE is raised.

This message was sent by Atlassian Jira

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message