ranger-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Don Bosco Durai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (RANGER-2128) Implement SparkSQL plugin
Date Sun, 15 Jul 2018 06:05:00 GMT

    [ https://issues.apache.org/jira/browse/RANGER-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544410#comment-16544410
] 

Don Bosco Durai commented on RANGER-2128:
-----------------------------------------

{quote}You can try Spark 2.3.1, because this change https://github.com/apache/spark/blob/branch-2.3/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala#L129
ensures the SessionState that contains the thrift user body will be reused.{quote}
[~Qin Yao] thanks. I was able to get the user from the State. In the AuthzImpl, the following
code gave the session user. I will update the Ranger Authorizer to use this user

{code:java}
clientImpl.state.getUserName()
{code}

Regarding the ClassCastException, "org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassCastException: org.apache.hadoop.hive.metastore.ObjectStore cannot be cast
to org.apache.hadoop.hive.metastore.RawStore", I got this error even after I removed all HiveAuthorizer
related code. Do you think this is because of different class loader that might be used when
we do "ext.injectOptimizerRule(Authorizer)" in the case of Thrift Server? You are familiar
with Spark, any clue is appreciated. Thanks


> Implement SparkSQL plugin
> -------------------------
>
>                 Key: RANGER-2128
>                 URL: https://issues.apache.org/jira/browse/RANGER-2128
>             Project: Ranger
>          Issue Type: New Feature
>          Components: plugins, Ranger
>    Affects Versions: 1.1.0
>            Reporter: t oo
>            Assignee: Kent Yao
>            Priority: Major
>             Fix For: 2.0.0
>
>         Attachments: support_ranger11.tgz
>
>
> Implement SparkSQL plugin



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message