spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kazuaki Ishizaki" <>
Subject RE: [VOTE] Release Apache Spark 2.4.4 (RC3)
Date Wed, 28 Aug 2019 10:06:54 GMT
Built and tested with `mvn -Pyarn -Phadoop-2.7 -Pkubernetes -Pkinesis-asl 
-Phive -Phive-thriftserver test` on OpenJDK 1.8.0_211 on Ubuntu 16.04 

Kazuaki Ishizaki

From:   Dongjoon Hyun <>
To:     dev <>
Date:   2019/08/28 12:14
Subject:        [EXTERNAL] Re: [VOTE] Release Apache Spark 2.4.4 (RC3)


- Checked checksums and signatures of artifacts.
- Checked to have all binaries and maven repo.
- Checked document generation (including a new change after RC2)
- Build with `-Pyarn -Pmesos -Pkubernetes -Phive -Phive-thriftserver 
-Phadoop-2.6` on AdoptOpenJDK8_202.
- Tested with both Scala-2.11/Scala-2.12 and both Python2/3.
   Python 2.7.15 with numpy 1.16.4, scipy 1.2.2, pandas 0.19.2, pyarrow 
   Python 3.6.4 with numpy 1.16.4, scipy 1.2.2, pandas 0.23.2, pyarrow 
- Tested JDBC IT.


On Tue, Aug 27, 2019 at 4:05 PM Dongjoon Hyun <> 
Please vote on releasing the following candidate as Apache Spark version 

The vote is open until August 30th 5PM PST and passes if a majority +1 PMC 
votes are cast, with a minimum of 3 +1 votes.

[ ] +1 Release this package as Apache Spark 2.4.4
[ ] -1 Do not release this package because ...

To learn more about Apache Spark, please see

The tag to be voted on is v2.4.4-rc3 (commit 

The release files, including signatures, digests, etc. can be found at:

Signatures used for Spark RCs can be found in this file:

The staging repository for this release can be found at:

The documentation corresponding to this release can be found at:

The list of bug fixes going into 2.4.4 can be found at the following URL:

This release is using the release script of the tag v2.4.4-rc3.


How can I help test this release?

If you are a Spark user, you can help us test this release by taking
an existing Spark workload and running on this release candidate, then
reporting any regressions.

If you're working in PySpark you can set up a virtual env and install
the current RC and see if anything important breaks, in the Java/Scala
you can add the staging repository to your projects resolvers and test
with the RC (make sure to clean up the artifact cache before/after so
you don't end up building with a out of date RC going forward).

What should happen to JIRA tickets still targeting 2.4.4?

The current list of open tickets targeted at 2.4.4 can be found at: and search for "Target 
Version/s" = 2.4.4

Committers should look at those and triage. Extremely important bug
fixes, documentation, and API tweaks that impact compatibility should
be worked on immediately. Everything else please retarget to an
appropriate release.

But my bug isn't fixed?

In order to make timely releases, we will typically not hold the
release unless the bug in question is a regression from the previous
release. That being said, if there is something which is a regression
that has not been correctly targeted please ping me or a committer to
help target the issue.

View raw message