spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel de Oliveira Mantovani <daniel.oliveira.mantov...@gmail.com>
Subject Re: [apache spark] Does Spark 2.4.8 have issues with ServletContextHandler
Date Mon, 14 Jun 2021 16:57:30 GMT
Did you include Apache Spark dependencies in your build? if you did, you
should remove it. If you are using sbt, all spark dependencies should be as
"provided".

On Wed, Jun 2, 2021 at 10:11 AM Kanchan Kauthale <
kanchankauthale08@gmail.com> wrote:

> Hello Sean,
>
> Please find below the stack trace-
>
> java.lang.NoclassDefFoundError: Could not initialize class
> org.spark.project.jetty.servlet.ServletContextHandler
>  at
> org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:143)
>  at
> org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:130)
>  at org.apache.spark.ui.WebUI.attachPage(WebUI.scala:89)
>  at org.apache.spark.ui.WebUI$$anonfun$attachTab$1.apply(WebUI.scala:71)
>  at org.apache.spark.ui.WebUI$$anonfun$attachTab$1.apply(WebUI.scala:71)
>  at
> scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
>  at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
>  at org.apache.spark.ui.WebUI.attachTab(WebUI.scala:71)
>  at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:62)
>  at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:80)
>  at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:178)
>  at org.apache.spark.SparkContext.<init>(SparkContext.scala:444)
>  at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2526)
>  at org.apache.spark.SparkContext.getOrCreate(SparkContext.scala)
>
> Any help regarding this, much appreciated.
> Thank you
> Kanchan Kauthale
>
> On Tue, Jun 1, 2021 at 12:49 PM Kanchan Kauthale <
> kanchankauthale08@gmail.com> wrote:
>
>> Thank you Sean for having look at my query. I am checking environment at
>> my end.
>>
>> The code belong to my organization environment and I don't have it in my
>> local environment so waiting for confirmation from compliance team to get
>> the error and stack trace out of organization environment.
>>
>> I will get back to you.
>>
>> Thank you again
>> Kanchan Kauthale
>>
>> On Thu, May 27, 2021, 18:52 Sean Owen <srowen@gmail.com> wrote:
>>
>>> Despite the name, the error doesn't mean the class isn't found but could
>>> not be initialized. What's the rest of the error?
>>> I don't believe any testing has ever encountered this error, so it's
>>> likely something to do with your environment, but I don't know what.
>>>
>>> On Thu, May 27, 2021 at 7:32 AM Kanchan Kauthale <
>>> kanchankauthale08@gmail.com> wrote:
>>>
>>>> Hello,
>>>>
>>>> We have an existing project which works fine with Spark 2.4.7. We want
>>>> to upgrade the spark version to 2.4.8. Scala version we are using is- 2.11
>>>> After building with upgraded pom, we are getting error below for test cases-
>>>>
>>>> java.lang.NoClassDefFoundError: Could not initialize class
>>>> org.spark_object.jetty.servlet.ServletContextHandler
>>>> at
>>>> org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:143)
>>>>
>>>> When I checked in Maven dependencies, I could find the
>>>> ServletContextHandlerclass under spark-core_2.11-2.4.8.jar in given package
>>>> hierarchy. I have compiled code, dependencies have been resolved, classpath
>>>> is updated.
>>>>
>>>> Any hint regarding this error would help.
>>>>
>>>>
>>>> Thank you
>>>>
>>>> Kanchan
>>>>
>>>

-- 

--
Daniel Mantovani

Mime
View raw message