spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wuyi <yi...@databricks.com>
Subject Re: [DISCUSS] Apache Spark 3.0.1 Release
Date Sun, 05 Jul 2020 11:42:10 GMT
Please also includes https://issues.apache.org/jira/browse/SPARK-32120 in
Spark 3.0.1. It's a regression compares to Spark 3.0.0-preview2.

Thanks,
Yi Wu


Yuanjian Li wrote
> Hi dev-list,
> 
> I’m writing this to raise the discussion about Spark 3.0.1 feasibility
> since 4 blocker issues were found after Spark 3.0.0:
> 
> 
>    1.
> 
>    [SPARK-31990] &lt;https://issues.apache.org/jira/browse/SPARK-31990&gt;
> The
>    state store compatibility broken will cause a correctness issue when
>    Streaming query with `dropDuplicate` uses the checkpoint written by the
> old
>    Spark version.
>    2.
> 
>    [SPARK-32038] &lt;https://issues.apache.org/jira/browse/SPARK-32038&gt;
> The
>    regression bug in handling NaN values in COUNT(DISTINCT)
>    3.
> 
>    [SPARK-31918]
> &lt;https://issues.apache.org/jira/browse/SPARK-31918&gt;[WIP]
>    CRAN requires to make it working with the latest R 4.0. It makes the
> 3.0
>    release unavailable on CRAN, and only supports R [3.5, 4.0)
>    4.
> 
>    [SPARK-31967] &lt;https://issues.apache.org/jira/browse/SPARK-31967&gt;
>    Downgrade vis.js to fix Jobs UI loading time regression
> 
> 
> I also noticed branch-3.0 already has 39 commits
> &lt;https://issues.apache.org/jira/browse/SPARK-32038?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%203.0.1&gt;
> after Spark 3.0.0. I think it would be great if we have Spark 3.0.1 to
> deliver the critical fixes.
> 
> Any comments are appreciated.
> 
> Best,
> 
> Yuanjian





--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Mime
View raw message