hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Noah Watkins (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6136) MRAppMaster doesn't shutdown file systems
Date Thu, 23 Oct 2014 01:10:34 GMT
Noah Watkins created MAPREDUCE-6136:

             Summary: MRAppMaster doesn't shutdown file systems
                 Key: MAPREDUCE-6136
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6136
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: applicationmaster
    Affects Versions: 2.4.1
            Reporter: Noah Watkins

When MRAppMaster exit it doesn't call close on its open file systems instances.

MAPREDUCE-3614 sets conf.setBoolean("fs.automatic.close", false); in MRAppMaster::main and
then called FileSystem.closeAll() in MRAppMasterShutdownHook.

However, MAPREDUCE-4205 removed the call to FileSystem.closeAll() MRAppMasterShutdownHook
but left `fs.automatic.close` set to false.

Removing `conf.setBoolean("fs.automatic.close", false);` worked for me, but it wasn't clear
if this had other implications.

This message was sent by Atlassian JIRA

View raw message