spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tianhua huang <>
Subject Status of Spark testing on ARM64
Date Mon, 25 Nov 2019 12:39:15 GMT
Hi all,
I will give you some informations about ARM CI of Spark:

Our team and community are working on build/test Spark master on ARM64
server, after find and fix some issues[1], we have integrated two ARM
testing jobs[2] to community CI(AMPLAB Jenkins),
they run as daily job and have been stablely running for few weeks, and the
two ARM testing jobs are success generally.
Thanks Sean Owen, Shane Knapp, Dongjoon Hyun and community to help us :)

If you are interested, please have a try:)  Before merged, you have to download and
maven install org.openlabtesting.leveldbjni:leveldbjni-all.1.8 using

mvn install:install-file -DgroupId=org.fusesource.leveldbjni
-DartifactId=leveldbjni-all -Dversion=1.8 -Dpackaging=jar
Then, you can build and test Spark on ARM64 server.

If you have any questions, please don't hesitate to contact me, thanks all!

[1]: ( ( ( ( (
<>   ( --- this one is in progress

     The job spark-master-test-maven-arm same with community x86 job
     It runs all java/scala tests, the test number is about 21,112.
     The job spark-master-test-python-arm runs pyspark tests with python3.6.

View raw message