hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Larry McCay (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10357) Memory Leak in UserGroupInformation.doAs for JDBC Connection to Hive
Date Wed, 05 Mar 2014 15:19:43 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13920956#comment-13920956
] 

Larry McCay commented on HADOOP-10357:
--------------------------------------

I see that HadoopThriftAuthBridge20S calls setConfiguration in:

   @Override
   public Client createClientWithConf(String authType) {
     Configuration conf = new Configuration();
     conf.set(HADOOP_SECURITY_AUTHENTICATION, authType);
     UserGroupInformation.setConfiguration(conf);
     return new Client();
   }

If this class is in play that would explain the multiple calls to initialize.

> Memory Leak in UserGroupInformation.doAs for JDBC Connection to Hive
> --------------------------------------------------------------------
>
>                 Key: HADOOP-10357
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10357
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 1.2.0
>            Reporter: Larry McCay
>         Attachments: visualvm-hive.png
>
>
> When using UGI.doAs in order to make a connection there appears to be a memory leak involving
the UGI that is used for the doAs and the UGI held by TUGIAssumingTransport.
> When using this approach to establishing a JDBC connection in an environment that will
serve many users and requests client side eventually runs out of memory.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message