spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Hamstra <m...@clearstorydata.com>
Subject Re: RFC: removing Scala 2.10
Date Tue, 07 Mar 2017 15:50:05 GMT
>
> I don't think 2.10 and 2.12 support can coexist, and soon, 2.12 support
> will be important.
>

Which is why I'm thinking that we should pull 2.10 support out of master
soon -- either immediately or right after 2.2 goes into RC or full release.

On Tue, Mar 7, 2017 at 2:14 AM, Sean Owen <sowen@cloudera.com> wrote:

> (2.10 was already deprecated for 2.1, so that's done actually.)
>
> Personally I'm fine with leaving in 2.10 support for 2.2. (FWIW CDH is
> Scala 2.11-only for Spark 2.) If there were no voices in support of keeping
> it, might be worth moving on right now, but if there's any substantive
> argument against, I'd also punt it another release.
>
> It's not really driven by cleanup, though that's nice, but 2.12 support. I
> don't think 2.10 and 2.12 support can coexist, and soon, 2.12 support will
> be important.
>
> How about tagging this for 2.3.0, as well as targeting 2.12 support for
> 2.3.0?
>
> On Tue, Mar 7, 2017 at 2:38 AM Reynold Xin <rxin@databricks.com> wrote:
>
>> Thanks for sending an email. I was going to +1 but then I figured I
>> should be data driven. I took a look at the distribution of Scala versions
>> across all the clusters Databricks runs (which is a very high number across
>> a variety of tech startups, SMBs, large enterprises, and this is the chart:
>>
>> [image: scala-version.png]
>>
>>
>>
>> Given 30% are still on Scala 2.10, I'd say we should officially deprecate
>> Scala 2.10 in Spark 2.2 and remove the support in a future release (e.g.
>> 2.3). Note that in the past we only deprecated Java 7 / Python 2.6 in 2.0,
>> and didn't do anything with Scala 2.10.
>>
>>
>>
>>
>> On Mon, Mar 6, 2017 at 1:18 AM, Sean Owen <sowen@cloudera.com> wrote:
>>
>> Another call for comments on removal of Scala 2.10 support, if you
>> haven't already. See
>>
>> https://github.com/apache/spark/pull/17150
>> http://issues.apache.org/jira/browse/SPARK-19810
>>
>> I've heard several votes in support and no specific objections at this
>> point, but wanted to make another call to check for any doubts before I go
>> ahead for Spark 2.2.
>>
>>
>>

Mime
View raw message