spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Huaxin Gao (Jira)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-30990) Binary incompatibility changes
Date Mon, 02 Mar 2020 05:04:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-30990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047953#comment-17047953
] 

Huaxin Gao edited comment on SPARK-30990 at 3/2/20 5:03 AM:
------------------------------------------------------------

cc [~smilegator]

I audited all the MiMa exclusions  added for 3.0 (except ML related ones which are documented
in https://issues.apache.org/jira/browse/SPARK-30928):

A few of them are not necessary any more. I removed those in these two PRs:

[https://github.com/apache/spark/pull/27729]

[https://github.com/apache/spark/pull/27731]

Here are the results of my auditing:

False Positive:
 https://issues.apache.org/jira/browse/SPARK-29306
 remove case class in private object

https://issues.apache.org/jira/browse/SPARK-28486
 remove method from a private class

https://issues.apache.org/jira/browse/SPARK-27090
 remove private member variable

https://issues.apache.org/jira/browse/SPARK-26254
 rename a private class

https://issues.apache.org/jira/browse/SPARK-24109
 remove a private variable in a private object

https://issues.apache.org/jira/browse/SPARK-25680
 change a private constructor

https://issues.apache.org/jira/browse/SPARK-23781
 remove private method

https://issues.apache.org/jira/browse/SPARK-26362
 change private methods

https://issues.apache.org/jira/browse/SPARK-26457
 private constructor change

https://issues.apache.org/jira/browse/SPARK-28957
 change method in a private class

https://issues.apache.org/jira/browse/SPARK-29348
 change private constructor

https://issues.apache.org/jira/browse/SPARK-29543
 change private constructor

https://issues.apache.org/jira/browse/SPARK-30667
 change private case class

https://issues.apache.org/jira/browse/SPARK-26141

Java private classes

Methods added in 3.0.0 (ReversedMissingMethodProblem)
 https://issues.apache.org/jira/browse/SPARK-27366
 https://issues.apache.org/jira/browse/SPARK-29417
 https://issues.apache.org/jira/browse/SPARK-24243

Remove deprecated:
 https://issues.apache.org/jira/browse/SPARK-25908
 https://issues.apache.org/jira/browse/SPARK-16775
 https://issues.apache.org/jira/browse/SPARK-25862
 https://issues.apache.org/jira/browse/SPARK-28199

https://issues.apache.org/jira/browse/SPARK-28980

Breaking API change:
 https://issues.apache.org/jira/browse/SPARK-29399
 remove a public interface (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26132
 remove support for Scala 2.11 in Spark 3.0.0

https://issues.apache.org/jira/browse/SPARK-26329
 add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26311
 add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-27630
 add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26632
 SparkTransportConf.fromSparkConf signature change

https://issues.apache.org/jira/browse/SPARK-25737
 remove JavaSparkContextVarargsWorkaround
 It has release notes

https://issues.apache.org/jira/browse/SPARK-19287
 JavaPairRDD flatMapValues requires function returning Iterable, not Iterator
 it has release notes

https://issues.apache.org/jira/browse/SPARK-26193
 add a new member variable to a class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-27521
 move data source v2 API to catalyst module

https://issues.apache.org/jira/browse/SPARK-26216
 The implementation of UserDefinedFunction changed to a trait in Spark 3.0.0.
 Migration guide was updated

https://issues.apache.org/jira/browse/SPARK-28556
 method signature changed (it's a DeveloperApi)
 it has release notes

https://issues.apache.org/jira/browse/SPARK-25341
 class signature changed

https://issues.apache.org/jira/browse/SPARK-25528
 data source V2 API refactoring

 

 


was (Author: huaxingao):
cc [~smilegator]

I audited all the MiMa exclusions  added for 3.0 (except ML related ones which are documented
in https://issues.apache.org/jira/browse/SPARK-30928):

A few of them are not necessary any more. I removed those in these two PRs:

[https://github.com/apache/spark/pull/27729]

[https://github.com/apache/spark/pull/27731]

Here are the results of my auditing:

False Positive:
 https://issues.apache.org/jira/browse/SPARK-29306
 remove case class in private object

https://issues.apache.org/jira/browse/SPARK-28486
 remove method from a private class

https://issues.apache.org/jira/browse/SPARK-27090
 remove private member variable

https://issues.apache.org/jira/browse/SPARK-26254
 rename a private class

https://issues.apache.org/jira/browse/SPARK-24109
 remove a private variable in a private object

https://issues.apache.org/jira/browse/SPARK-25680
 change a private constructor

https://issues.apache.org/jira/browse/SPARK-23781
 remove private method

https://issues.apache.org/jira/browse/SPARK-26362
 change private methods

https://issues.apache.org/jira/browse/SPARK-26457
 private constructor change

https://issues.apache.org/jira/browse/SPARK-28957
 change method in a private class

https://issues.apache.org/jira/browse/SPARK-29348
 change private constructor

https://issues.apache.org/jira/browse/SPARK-29543
 change private constructor

https://issues.apache.org/jira/browse/SPARK-30667
 change private case class

Methods added in 3.0.0 (ReversedMissingMethodProblem)
 https://issues.apache.org/jira/browse/SPARK-27366
 https://issues.apache.org/jira/browse/SPARK-29417
 https://issues.apache.org/jira/browse/SPARK-24243

Remove deprecated:
 https://issues.apache.org/jira/browse/SPARK-25908
 https://issues.apache.org/jira/browse/SPARK-16775
 https://issues.apache.org/jira/browse/SPARK-25862
 https://issues.apache.org/jira/browse/SPARK-28199

https://issues.apache.org/jira/browse/SPARK-28980

Breaking API change:
 https://issues.apache.org/jira/browse/SPARK-29399
 remove a public interface (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26132
 remove support for Scala 2.11 in Spark 3.0.0

https://issues.apache.org/jira/browse/SPARK-26329
 add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26311
 add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-27630
 add a new member variable to a case class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-26632
 SparkTransportConf.fromSparkConf signature change

https://issues.apache.org/jira/browse/SPARK-25737
 remove JavaSparkContextVarargsWorkaround
 It has release notes

https://issues.apache.org/jira/browse/SPARK-19287
 JavaPairRDD flatMapValues requires function returning Iterable, not Iterator
 it has release notes

https://issues.apache.org/jira/browse/SPARK-26193
 add a new member variable to a class (it's a DeveloperApi)

https://issues.apache.org/jira/browse/SPARK-27521
 move data source v2 API to catalyst module

https://issues.apache.org/jira/browse/SPARK-26216
 The implementation of UserDefinedFunction changed to a trait in Spark 3.0.0.
 Migration guide was updated

https://issues.apache.org/jira/browse/SPARK-28556
 method signature changed (it's a DeveloperApi)
 it has release notes

https://issues.apache.org/jira/browse/SPARK-25341
 class signature changed

https://issues.apache.org/jira/browse/SPARK-25528
 data source V2 API refactoring

 

 

> Binary incompatibility changes
> ------------------------------
>
>                 Key: SPARK-30990
>                 URL: https://issues.apache.org/jira/browse/SPARK-30990
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core, SQL
>    Affects Versions: 3.0.0
>            Reporter: Huaxin Gao
>            Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message