hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chuanjie.duan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13090) Hive metastore crashes on NPE with ZooKeeperTokenStore
Date Tue, 05 Sep 2017 09:59:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153409#comment-16153409
] 

chuanjie.duan commented on HIVE-13090:
--------------------------------------

I just apply the patch on hive1.2.1, but TTransportException: DIGEST-MD5: IO error acquiring
password always print in log while I closing beeline client. How about catching and logging
it as a warning log instand of just throw it . (catch the InvalidToken Exception in HadoopThriftAuthBridge.Server.TUGIAssumingProcessor.process())

2017-09-01 16:35:46,859 ERROR [pool-3-thread-6]: transport.TSaslTransport (TSaslTransport.java:open(315))
- SASL negotiation failure
javax.security.sasl.SaslException: DIGEST-MD5: IO error acquiring password [Caused by org.apache.hadoop.security.token.SecretManager$InvalidToken:
token expired or does not exist: owner=xx, renewer=xx, realUser=hive/xxxxxx@xxxxx.COM, issueDate=1504254940782,
maxDate=1504859740782, sequenceNumber=1, masterKeyId=12]
        at com.sun.security.sasl.digest.DigestMD5Server.validateClientResponse(DigestMD5Server.java:594)
        at com.sun.security.sasl.digest.DigestMD5Server.evaluateResponse(DigestMD5Server.java:244)
        at org.apache.thrift.transport.TSaslTransport$SaslParticipant.evaluateChallengeOrResponse(TSaslTransport.java:539)
        at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:283)
        at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:739)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:736)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:356)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:736)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:268)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.security.token.SecretManager$InvalidToken: token expired or does
not exist: owner=xxx, renewer=xxx, realUser=hive/xxxx@xxxxx.COM, issueDate=1504254940782,
maxDate=1504859740782, sequenceNumber=1, masterKeyId=12
        at org.apache.hadoop.hive.thrift.TokenStoreDelegationTokenSecretManager.retrievePassword(TokenStoreDelegationTokenSecretManager.java:114)
        at org.apache.hadoop.hive.thrift.TokenStoreDelegationTokenSecretManager.retrievePassword(TokenStoreDelegationTokenSecretManager.java:56)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$SaslDigestCallbackHandler.getPassword(HadoopThriftAuthBridge.java:565)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$SaslDigestCallbackHandler.handle(HadoopThriftAuthBridge.java:596)
        at com.sun.security.sasl.digest.DigestMD5Server.validateClientResponse(DigestMD5Server.java:585)
        ... 15 more

> Hive metastore crashes on NPE with ZooKeeperTokenStore
> ------------------------------------------------------
>
>                 Key: HIVE-13090
>                 URL: https://issues.apache.org/jira/browse/HIVE-13090
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore, Security
>    Affects Versions: 1.0.0, 1.1.1, 1.2.1
>            Reporter: Thejas M Nair
>            Assignee: Piotr WikieĊ‚
>             Fix For: 1.3.0, 2.0.1, 2.1.0
>
>         Attachments: HIVE-13090.1.patch
>
>
> Observed that hive metastore shutdown with NPE from ZookeeperTokenStore.
> {code}
> INFO  [pool-5-thread-192]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(714))
- 191: Metastore shutdown complete.
>  INFO  [pool-5-thread-192]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(340))
- ugi=cvdpqap	ip=/19.1.2.129	cmd=Metastore shutdown complete.	
>  ERROR [Thread[Thread-6,5,main]]: thrift.TokenStoreDelegationTokenSecretManager (TokenStoreDelegationTokenSecretManager.java:run(331))
- ExpiredTokenRemover thread received unexpected exception. org.apache.hadoop.hive.thrift.DelegationTokenStore$TokenStoreException:
Failed to decode token
> org.apache.hadoop.hive.thrift.DelegationTokenStore$TokenStoreException: Failed to decode
token
> 	at org.apache.hadoop.hive.thrift.ZooKeeperTokenStore.getToken(ZooKeeperTokenStore.java:401)
> 	at org.apache.hadoop.hive.thrift.TokenStoreDelegationTokenSecretManager.removeExpiredTokens(TokenStoreDelegationTokenSecretManager.java:256)
> 	at org.apache.hadoop.hive.thrift.TokenStoreDelegationTokenSecretManager$ExpiredTokenRemover.run(TokenStoreDelegationTokenSecretManager.java:319)
> 	at java.lang.Thread.run(Thread.java:744)
> Caused by: java.lang.NullPointerException
> 	at java.io.ByteArrayInputStream.<init>(ByteArrayInputStream.java:106)
> 	at org.apache.hadoop.security.token.delegation.HiveDelegationTokenSupport.decodeDelegationTokenInformation(HiveDelegationTokenSupport.java:53)
> 	at org.apache.hadoop.hive.thrift.ZooKeeperTokenStore.getToken(ZooKeeperTokenStore.java:399)
> 	... 3 more
>  INFO  [Thread-3]: metastore.HiveMetaStore (HiveMetaStore.java:run(5639)) - Shutting
down hive metastore.
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message