spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adam Roberts <AROBE...@uk.ibm.com>
Subject Re: [VOTE] Apache Spark 2.1.1 (RC3)
Date Thu, 20 Apr 2017 13:56:41 GMT
+1 (non-binding), looks good

Tested on RHEL 7.2, 7.3, CentOS 7.2, Ubuntu 14 04 and 16 04, SUSE 12, x86, 
IBM Linux on Power and IBM Linux on Z (big-endian)

No problems with latest IBM Java, Hadoop 2.7.3 and Scala 2.11.8, no 
performance concerns to report either (spark-sql-perf and HiBench)

Built with mvn -T 1C -Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver 
-DskipTests clean package
Tested with mvn -Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver 
-Dtest.exclude.tags=org.apache.spark.tags.DockerTest -fn test





From:   Felix Cheung <felixcheung_m@hotmail.com>
To:     Reynold Xin <rxin@databricks.com>, Dong Joon Hyun 
<dhyun@hortonworks.com>, Marcelo Vanzin <vanzin@cloudera.com>, Denny Lee 
<denny.g.lee@gmail.com>
Cc:     Michael Armbrust <michael@databricks.com>, "dev@spark.apache.org" 
<dev@spark.apache.org>
Date:   20/04/2017 08:13
Subject:        Re: [VOTE] Apache Spark 2.1.1 (RC3)



Tested on both Linux and Windows, as package.

Found StackOverflowError with ALS on Windows
https://issues.apache.org/jira/browse/SPARK-20402
 
This is part of the R CRAN check to build the vignettes. Very simple, 
quick and consistent repo on Windows. The exact same code works fine on 
Linux. Reproduces the same error with 2.1.1 RC2 but didn't see before 
because was blocked by a different issue then. 2.1.0 release didn't have 
ALS R API.

Will convert code to Scala to check and investigate further.

I'm not sure if we would consider this a blocker, but it might block R 
package release to CRAN.
_____________________________
From: Denny Lee <denny.g.lee@gmail.com>
Sent: Wednesday, April 19, 2017 11:00 PM
Subject: Re: [VOTE] Apache Spark 2.1.1 (RC3)
To: Reynold Xin <rxin@databricks.com>, Dong Joon Hyun <
dhyun@hortonworks.com>, Marcelo Vanzin <vanzin@cloudera.com>
Cc: Michael Armbrust <michael@databricks.com>, <dev@spark.apache.org>


+1 (non-binding)


On Wed, Apr 19, 2017 at 9:23 PM Dong Joon Hyun <dhyun@hortonworks.com> 
wrote:
+1

I tested RC3 on CentOS 7.3.1611/OpenJDK 1.8.0_121/R 3.3.3
with `-Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive -Phive-thriftserver 
–Psparkr`

At the end of R test, I saw `Had CRAN check errors; see logs.`,
but tests passed and log file looks good.

Bests,
Dongjoon.

From: Reynold Xin <rxin@databricks.com>
Date: Wednesday, April 19, 2017 at 3:41 PM
To: Marcelo Vanzin <vanzin@cloudera.com>
Cc: Michael Armbrust <michael@databricks.com>, "dev@spark.apache.org" <
dev@spark.apache.org>
Subject: Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1

On Wed, Apr 19, 2017 at 3:31 PM, Marcelo Vanzin <vanzin@cloudera.com> 
wrote:
+1 (non-binding).

Ran the hadoop-2.6 binary against our internal tests and things look good.

On Tue, Apr 18, 2017 at 11:59 AM, Michael Armbrust
<michael@databricks.com> wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 2.1.1. The vote is open until Fri, April 21st, 2018 at 13:00 PST and 
passes
> if a majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 2.1.1
> [ ] -1 Do not release this package because ...
>
>
> To learn more about Apache Spark, please see http://spark.apache.org/
>
> The tag to be voted on is v2.1.1-rc3
> (2ed19cff2f6ab79a718526e5d16633412d8c4dd4)
>
> List of JIRA tickets resolved can be found with this filter.
>
> The release files, including signatures, digests, etc. can be found at:
> http://home.apache.org/~pwendell/spark-releases/spark-2.1.1-rc3-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1230/
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-releases/spark-2.1.1-rc3-docs/
>
>
> FAQ
>
> How can I help test this release?
>
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions.
>
> What should happen to JIRA tickets still targeting 2.1.1?
>
> Committers should look at those and triage. Extremely important bug 
fixes,
> documentation, and API tweaks that impact compatibility should be worked 
on
> immediately. Everything else please retarget to 2.1.2 or 2.2.0.
>
> But my bug isn't fixed!??!
>
> In order to make timely releases, we will typically not hold the release
> unless the bug in question is a regression from 2.1.0.
>
> What happened to RC1?
>
> There were issues with the release packaging and as a result was 
skipped.



--
Marcelo

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org






Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

Mime
View raw message