spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <>
Subject [jira] [Commented] (SPARK-17828) Changes file missing in Spark 2
Date Mon, 10 Oct 2016 08:13:20 GMT


Reynold Xin commented on SPARK-17828:

I would just remove this.

> Changes file missing in Spark 2
> -------------------------------
>                 Key: SPARK-17828
>                 URL:
>             Project: Spark
>          Issue Type: Documentation
>          Components: Documentation
>    Affects Versions: 2.0.2, 2.1.0
>            Reporter: Adam Roberts
>            Priority: Minor
> In Spark 1.x releases we provided the CHANGES.txt file which proved useful to know exactly
the differences and commit IDs between releases
> In Spark 2.x we made packaging changes (moving to be under dev and
different structure for the important Spark classes e.g. no big assembly jar), so I expect
work wasn't done to ensure the changes file was still being provided
> Note that users can view the release notes online (
so I don't know if there is merit in including this file in the distribution, but I've had
a look in the codebase and noticed the script used to generate said file is still present
in master and definitely out of date:
here we see the last commit is from the 27th of August 2014
> {code}
> SPARK_HOME = os.environ["SPARK_HOME"]
> {code}
> If we change this to 
> {code}
> SPARK_HOME = os.environ["SPARK_HOME"]
> {code}
> we can create a file
> So I think this file should be either be removed in 2.x. or updated across our currently
maintained branches and then we'd need to run the make-distribution script to ensure the file
is picked up and included in the distribution
> I see no JIRAs mentioning "changes" under the spark project and no discussion of this
on either mailing list. I downloaded the Spark 2.0.0 tgz (no 2.0.1 tgz at
and verified there is no changes file here.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message