spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dr. Kent Yao" <yaooq...@qq.com>
Subject Re: [VOTE] Apache Spark 3.0.0 RC1
Date Wed, 01 Apr 2020 10:31:45 GMT
-1
Do not release this package because v3.0.0 is the 3rd major release since we
added Spark On Kubernetes. Can we make it more production-ready as it has
been experimental for more than 2 years? 

The main practical adoption of Spark on Kubernetes is to take on the role of
other cluster managers(mainly YARN). And the storage layer(mainly HDFS)
would be more likely kept anyway. But Spark on Kubernetes with HDFS seems
not to work properly.

e.g.
This ticket and PR were submitted 7 months ago, and never get reviewed.
https://issues.apache.org/jira/browse/SPARK-29974
https://issues.apache.org/jira/browse/SPARK-28992
https://github.com/apache/spark/pull/25695

And this.
https://issues.apache.org/jira/browse/SPARK-28896
https://github.com/apache/spark/pull/25609

In terms of how often this module is updated, it seems to be stable. 
But in terms of how often PRs for this module are reviewed, it seems that it
will stay experimental for a long time.

Thanks.



--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Mime
View raw message