spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Rosen <joshro...@databricks.com>
Subject Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3
Date Mon, 05 Oct 2015 21:39:46 GMT
I'm working on a fix for this right now. I'm planning to re-run a modified
copy of the release packaging scripts which will emit only the missing
artifacts (so we won't upload new artifacts with different SHAs for the
builds which *did* succeed).

I expect to have this finished in the next day or so; I'm currently blocked
by some infra downtime but expect that to be resolved soon.

- Josh

On Mon, Oct 5, 2015 at 8:46 AM, Nicholas Chammas <nicholas.chammas@gmail.com
> wrote:

> Blaž said:
>
> Also missing is
> http://s3.amazonaws.com/spark-related-packages/spark-1.5.1-bin-hadoop1.tgz
> which breaks spark-ec2 script.
>
> This is the package I am referring to in my original email.
>
> Nick said:
>
> It appears that almost every version of Spark up to and including 1.5.0
> has included a —bin-hadoop1.tgz release (e.g. spark-1.5.0-bin-hadoop1.tgz).
> However, 1.5.1 has no such package.
>
> Nick
> ​
>
> On Mon, Oct 5, 2015 at 3:27 AM Blaž Šnuderl <snuderl@gmail.com> wrote:
>
>> Also missing is http://s3.amazonaws.com/spark-related-packages/spark-
>> 1.5.1-bin-hadoop1.tgz which breaks spark-ec2 script.
>>
>> On Mon, Oct 5, 2015 at 5:20 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>>
>>> hadoop1 package for Scala 2.10 wasn't in RC1 either:
>>> http://people.apache.org/~pwendell/spark-releases/spark-1.5.1-rc1-bin/
>>>
>>> On Sun, Oct 4, 2015 at 5:17 PM, Nicholas Chammas <
>>> nicholas.chammas@gmail.com> wrote:
>>>
>>>> I’m looking here:
>>>>
>>>> https://s3.amazonaws.com/spark-related-packages/
>>>>
>>>> I believe this is where one set of official packages is published.
>>>> Please correct me if this is not the case.
>>>>
>>>> It appears that almost every version of Spark up to and including 1.5.0
>>>> has included a --bin-hadoop1.tgz release (e.g.
>>>> spark-1.5.0-bin-hadoop1.tgz).
>>>>
>>>> However, 1.5.1 has no such package. There is a
>>>> spark-1.5.1-bin-hadoop1-scala2.11.tgz package, but this is a separate
>>>> thing. (1.5.0 also has a hadoop1-scala2.11 package.)
>>>>
>>>> Was this intentional?
>>>>
>>>> More importantly, is there some rough specification for what packages
>>>> we should be able to expect in this S3 bucket with every release?
>>>>
>>>> This is important for those of us who depend on this publishing venue
>>>> (e.g. spark-ec2 and related tools).
>>>>
>>>> Nick
>>>> ​
>>>>
>>>
>>>
>>

Mime
View raw message