spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pasha Finkelshteyn <>
Subject Re: Running Apache Spark Streaming on the GraalVM Native Image
Date Wed, 01 Jul 2020 14:04:01 GMT
Hi Ivo, 

I believe there's absolutely no way that Spark will work on GraalVM
Native Image because Spark generates code and loads classes in runtime,
while GraalVM Native Image works only in closed world and has no any way
to load classes which are not present in classpath at compie time.

On 20/07/01 09:56AM, wrote:
> Hi guys,
> so I want to get Apache Spark to run on the GraalVM Native Image in a 
> simple single-node streaming application, but I get the following error, 
> when trying to build the native image: (check attached file)
> And as I researched online, there seems to be no successful combination of 
> Spark and GraalVM Native Image. Did anyone ever succeed and how?
> Best regards,
> Ivo

> ---------------------------------------------------------------------
> To unsubscribe e-mail:


Big Data Tools @ JetBrains

View raw message