Thank you for starting the thread.

In addition to that, we currently are testing Python 3.6 only in Apache Spark Jenkins environment.

Given that Python 3.8 is already out and Apache Spark 3.0.0 RC1 will start next January
(, I'm +1 for the deprecation (Python < 3.6) at Apache Spark 3.0.0.

It's just a deprecation to prepare the next-step development cycle.


On Thu, Oct 24, 2019 at 1:10 AM Maciej Szymkiewicz <> wrote:

Hi everyone,

While deprecation of Python 2 in 3.0.0 has been announced, there is no clear statement about specific continuing support of different Python 3 version.


  • Python 3.4 has been retired this year.
  • Python 3.5 is already in the "security fixes only" mode and should be retired in the middle of 2020.

Continued support of these two blocks adoption of many new Python features (PEP 468)  and it is hard to justify beyond 2020.

Should these two be deprecated in 3.0.0 as well?

Best regards,