spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dr. Kent Yao" <>
Subject Re: [VOTE] Apache Spark 3.0.0 RC1
Date Wed, 01 Apr 2020 10:31:45 GMT
Do not release this package because v3.0.0 is the 3rd major release since we
added Spark On Kubernetes. Can we make it more production-ready as it has
been experimental for more than 2 years? 

The main practical adoption of Spark on Kubernetes is to take on the role of
other cluster managers(mainly YARN). And the storage layer(mainly HDFS)
would be more likely kept anyway. But Spark on Kubernetes with HDFS seems
not to work properly.

This ticket and PR were submitted 7 months ago, and never get reviewed.

And this.

In terms of how often this module is updated, it seems to be stable. 
But in terms of how often PRs for this module are reviewed, it seems that it
will stay experimental for a long time.


Sent from:

To unsubscribe e-mail:

View raw message