hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-11157) ZKDelegationTokenSecretManager never shuts down listenerThreadPool
Date Wed, 29 Oct 2014 22:58:34 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Arun Suresh updated HADOOP-11157:
    Attachment: HADOOP-11157.2.patch

Uploading new patch.

Summary of changes :
* Changed the listener threadpool to a SingleThreadedExecutor so that ZK watch updates are
always processed in the order it is received.
* add/update/delete of a token used to updated the localCache first and then make changes
in ZK. Changed this to ensure that localCache is always updated as a result of a ZK notification.
* Fixed up the stopThreads to call super first
* During shutdown of AbstractDTSM, there can be calls to increment Delegation token seqnum
or KeyId.. which is a ZK operation now.. this used to result in an InterruptedException which
used to be thrown as a RuntimeException. This is now caught and ignored (There is no possibility
of an inconsistent state in ZK..)

I ran the test around 10 - 20 times in a loop.. Havnt seen an issue yet..

> ZKDelegationTokenSecretManager never shuts down listenerThreadPool
> ------------------------------------------------------------------
>                 Key: HADOOP-11157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11157
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 2.6.0
>            Reporter: Gregory Chanan
>            Assignee: Arun Suresh
>         Attachments: HADOOP-11157.2.patch, HADOOP-11157.patch, HADOOP-11157.patch
> I'm trying to integrate Solr with the DelegationTokenAuthenticationFilter and running
into this issue.  The solr unit tests look for leaked threads and when I started using the
ZKDelegationTokenSecretManager it started reporting leaks.  Shuting down the listenerThreadPool
after the objects that use it resolves the leak threads errors.

This message was sent by Atlassian JIRA

View raw message