spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Balog (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-6207) YARN secure cluster mode doesn't obtain a hive-metastore token
Date Tue, 17 Mar 2015 02:25:38 GMT

    [ https://issues.apache.org/jira/browse/SPARK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364441#comment-14364441
] 

Doug Balog commented on SPARK-6207:
-----------------------------------

Need to catch java.lang.UnsupportedOperationException and ignore,
or check to see if delegation token mode is supported with current configuration 
before trying to get a delegation token.
See  https://issues.apache.org/jira/browse/HIVE-4625


> YARN secure cluster mode doesn't obtain a hive-metastore token 
> ---------------------------------------------------------------
>
>                 Key: SPARK-6207
>                 URL: https://issues.apache.org/jira/browse/SPARK-6207
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Submit, SQL, YARN
>    Affects Versions: 1.2.0, 1.3.0, 1.2.1
>         Environment: YARN
>            Reporter: Doug Balog
>
> When running a spark job, on YARN in secure mode, with "--deploy-mode cluster",  org.apache.spark.deploy.yarn.Client()
does not obtain a delegation token to the hive-metastore. Therefore any attempts to talk to
the hive-metastore fail with a "GSSException: No valid credentials provided..."



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message