tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harish Jaiprakash (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3566) OOM because of too many DFSClient instances in TokenCache.obtainTokensForFileSystems
Date Tue, 20 Dec 2016 09:45:58 GMT
Harish Jaiprakash created TEZ-3566:
--------------------------------------

             Summary: OOM because of too many DFSClient instances in TokenCache.obtainTokensForFileSystems
                 Key: TEZ-3566
                 URL: https://issues.apache.org/jira/browse/TEZ-3566
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Harish Jaiprakash
            Assignee: Harish Jaiprakash


When FileSystem cache is disabled, invoking TokenCache.obtainTokensForFileSystems creates
lot of FileSystem objects which are unique and stored in a hash set. This takes up lot of
memory and causes OOM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message