spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "h2s (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-21697) NPE & ExceptionInInitializerError trying to load UTF from HDFS
Date Wed, 17 Jan 2018 06:00:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-21697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328304#comment-16328304
] 

h2s commented on SPARK-21697:
-----------------------------

my environment : spark-2.2.0 hadoop-2.10.

deleteĀ  spark/jars/commons-logging-1.1.3.jar,then it works well

> NPE & ExceptionInInitializerError trying to load UTF from HDFS
> --------------------------------------------------------------
>
>                 Key: SPARK-21697
>                 URL: https://issues.apache.org/jira/browse/SPARK-21697
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.1.1
>         Environment: Spark Client mode, Hadoop 2.6.0
>            Reporter: Steve Loughran
>            Priority: Minor
>
> Reported on [the PR|https://github.com/apache/spark/pull/17342#issuecomment-321438157]
for SPARK-12868: trying to load a UDF of HDFS is triggering an {{ExceptionInInitializerError}},
caused by an NPE which should only happen if the commons-logging {{LOG}} log is null.
> Hypothesis: the commons logging scan for {{commons-logging.properties}} is happening
in the classpath with the HDFS JAR; this is triggering a D/L of the JAR, which needs to force
in commons-logging, and, as that's not inited yet, NPEs



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message