spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan Blue <rb...@netflix.com.INVALID>
Subject Re: [VOTE] Apache Spark 2.1.1 (RC3)
Date Thu, 20 Apr 2017 16:58:39 GMT
-1 (non-binding)

Signatures, checksums, and release audit look fine, but there were 3 test
failures in spark-hive. I'm attaching the test report.

I'm running Ubuntu 16.04 with Java 1.8.0_121-b13.

Tested with:
JAVA_HOME="/usr/lib/jvm/java-8-oracle/" build/mvn test
-Dmaven.javadoc.skip=true -Dskip=true -Dsource.skip=true -P hadoop-2.7 -P
hadoop-provided -P hive-provided -P hive-thriftserver -P scala-2.11 -P yarn

Also, SPARK-20202 is outstanding without a path forward on patch releases.
Is the Hive community okay with patch releases continuing to depend on an
unofficial fork of Hive? From reading comments on the issue, this is still
unclear. HIVE-16391 was opened for a release of Hive 1.2.1 that Spark can
depend on, but it doesn't look like any progress has been made to resolve
it.

rb

On Thu, Apr 20, 2017 at 6:59 AM, Nicholas Chammas <
nicholas.chammas@gmail.com> wrote:

> Steve,
>
> I think you're a good person to ask about this. Is the below any cause for
> concern? Or did I perhaps test this incorrectly?
>
> Nick
>
>
> On Tue, Apr 18, 2017 at 11:50 PM Nicholas Chammas <
> nicholas.chammas@gmail.com> wrote:
>
>> I had trouble starting up a shell with the AWS package loaded
>> (specifically, org.apache.hadoop:hadoop-aws:2.7.3):
>>
>>
>>                 [NOT FOUND  ] com.sun.jersey#jersey-server;1.9!jersey-server.jar(bundle)
(0ms)
>>
>>         ==== local-m2-cache: tried
>>
>>           file:/home/ec2-user/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar
>>
>>                 [NOT FOUND  ] org.codehaus.jettison#jettison;1.1!jettison.jar(bundle)
(1ms)
>>
>>         ==== local-m2-cache: tried
>>
>>           file:/home/ec2-user/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar
>>
>>                 [NOT FOUND  ] com.sun.xml.bind#jaxb-impl;2.2.3-1!jaxb-impl.jar (0ms)
>>
>>         ==== local-m2-cache: tried
>>
>>           file:/home/ec2-user/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar
>>
>>                 ::::::::::::::::::::::::::::::::::::::::::::::
>>
>>                 ::              FAILED DOWNLOADS            ::
>>
>>                 :: ^ see resolution messages for details  ^ ::
>>
>>                 ::::::::::::::::::::::::::::::::::::::::::::::
>>
>>                 :: com.sun.jersey#jersey-json;1.9!jersey-json.jar(bundle)
>>
>>                 :: org.codehaus.jettison#jettison;1.1!jettison.jar(bundle)
>>
>>                 :: com.sun.xml.bind#jaxb-impl;2.2.3-1!jaxb-impl.jar
>>
>>                 :: com.sun.jersey#jersey-server;1.9!jersey-server.jar(bundle)
>>
>>                 ::::::::::::::::::::::::::::::::::::::::::::::
>>
>> Anyone know anything about this? I made sure to build Spark against the
>> appropriate version of Hadoop.
>>
>> Nick
>>
>> On Tue, Apr 18, 2017 at 2:59 PM Michael Armbrust <michael@databricks.com>
>> wrote:
>>
>> Please vote on releasing the following candidate as Apache Spark version
>>> 2.1.1. The vote is open until Fri, April 21st, 2018 at 13:00 PST and
>>> passes if a majority of at least 3 +1 PMC votes are cast.
>>>
>>> [ ] +1 Release this package as Apache Spark 2.1.1
>>> [ ] -1 Do not release this package because ...
>>>
>>>
>>> To learn more about Apache Spark, please see http://spark.apache.org/
>>>
>>> The tag to be voted on is v2.1.1-rc3
>>> <https://github.com/apache/spark/tree/v2.1.1-rc3> (2ed19cff2f6ab79
>>> a718526e5d16633412d8c4dd4)
>>>
>>> List of JIRA tickets resolved can be found with this filter
>>> <https://issues.apache.org/jira/browse/SPARK-20134?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%202.1.1>
>>> .
>>>
>>> The release files, including signatures, digests, etc. can be found at:
>>> http://home.apache.org/~pwendell/spark-releases/spark-2.1.1-rc3-bin/
>>>
>>> Release artifacts are signed with the following key:
>>> https://people.apache.org/keys/committer/pwendell.asc
>>>
>>> The staging repository for this release can be found at:
>>> https://repository.apache.org/content/repositories/orgapachespark-1230/
>>>
>>> The documentation corresponding to this release can be found at:
>>> http://people.apache.org/~pwendell/spark-releases/spark-2.1.1-rc3-docs/
>>>
>>>
>>> *FAQ*
>>>
>>> *How can I help test this release?*
>>>
>>> If you are a Spark user, you can help us test this release by taking an
>>> existing Spark workload and running on this release candidate, then
>>> reporting any regressions.
>>>
>>> *What should happen to JIRA tickets still targeting 2.1.1?*
>>>
>>> Committers should look at those and triage. Extremely important bug
>>> fixes, documentation, and API tweaks that impact compatibility should be
>>> worked on immediately. Everything else please retarget to 2.1.2 or 2.2.0.
>>>
>>> *But my bug isn't fixed!??!*
>>>
>>> In order to make timely releases, we will typically not hold the release
>>> unless the bug in question is a regression from 2.1.0.
>>>
>>> *What happened to RC1?*
>>>
>>> There were issues with the release packaging and as a result was skipped.
>>>
>> ‚Äč
>>
>


-- 
Ryan Blue
Software Engineer
Netflix

Mime
View raw message