spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yin Huai (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-15455) For IsolatedClientLoader, we need to provide a conf to disable sharing Hadoop classes
Date Fri, 20 May 2016 21:25:13 GMT
Yin Huai created SPARK-15455:
--------------------------------

             Summary: For IsolatedClientLoader, we need to provide a conf to disable sharing
Hadoop classes
                 Key: SPARK-15455
                 URL: https://issues.apache.org/jira/browse/SPARK-15455
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.0.0
            Reporter: Yin Huai
            Assignee: Yin Huai


Right now, we always share Hadoop classes between Spark side and the metastore client side
(HiveClientImpl). However, it is possible that the Hadoop used by the metastore client is
in a different version of Hadoop. Thus, in this case, we cannot share Hadoop classes. Once
we disable sharing Hadoop classes, we cannot pass a Hadoop Configuration to HiveClientImpl
because Configuration will be loaded by different classloaders.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message