spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kousuke Saruta <saru...@oss.nttdata.co.jp>
Subject Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt?
Date Mon, 04 Apr 2016 15:02:17 GMT
Oh, I overlooked that.  Thanks.

Kousuke

On 2016/04/04 22:58, Nicholas Chammas wrote:
> This is still an issue. The Spark 1.6.1 packages on S3 are corrupt.
>
> Is anyone looking into this issue? Is there anything contributors can 
> do to help solve this problem?
>
> Nick
>
> On Sun, Mar 27, 2016 at 8:49 PM Nicholas Chammas 
> <nicholas.chammas@gmail.com <mailto:nicholas.chammas@gmail.com>> wrote:
>
>     Pingity-ping-pong since this is still a problem.
>
>
>     On Thu, Mar 24, 2016 at 4:08 PM Michael Armbrust
>     <michael@databricks.com <mailto:michael@databricks.com>> wrote:
>
>         Patrick is investigating.
>
>         On Thu, Mar 24, 2016 at 7:25 AM, Nicholas Chammas
>         <nicholas.chammas@gmail.com
>         <mailto:nicholas.chammas@gmail.com>> wrote:
>
>             Just checking in on this again as the builds on S3 are
>             still broken. :/
>
>             Could it have something to do with us moving
>             |release-build.sh|
>             <https://github.com/apache/spark/commits/master/dev/create-release/release-build.sh>?
>
>             ​
>
>             On Mon, Mar 21, 2016 at 1:43 PM Nicholas Chammas
>             <nicholas.chammas@gmail.com
>             <mailto:nicholas.chammas@gmail.com>> wrote:
>
>                 Is someone going to retry fixing these packages? It's
>                 still a problem.
>
>                 Also, it would be good to understand why this is
>                 happening.
>
>                 On Fri, Mar 18, 2016 at 6:49 PM Jakob Odersky
>                 <jakob@odersky.com <mailto:jakob@odersky.com>> wrote:
>
>                     I just realized you're using a different download
>                     site. Sorry for the
>                     confusion, the link I get for a direct download of
>                     Spark 1.6.1 /
>                     Hadoop 2.6 is
>                     http://d3kbcqa49mib13.cloudfront.net/spark-1.6.1-bin-hadoop2.6.tgz
>
>                     On Fri, Mar 18, 2016 at 3:20 PM, Nicholas Chammas
>                     <nicholas.chammas@gmail.com
>                     <mailto:nicholas.chammas@gmail.com>> wrote:
>                     > I just retried the Spark 1.6.1 / Hadoop 2.6
>                     download and got a corrupt ZIP
>                     > file.
>                     >
>                     > Jakob, are you sure the ZIP unpacks correctly
>                     for you? Is it the same Spark
>                     > 1.6.1/Hadoop 2.6 package you had a success with?
>                     >
>                     > On Fri, Mar 18, 2016 at 6:11 PM Jakob Odersky
>                     <jakob@odersky.com <mailto:jakob@odersky.com>> wrote:
>                     >>
>                     >> I just experienced the issue, however retrying
>                     the download a second
>                     >> time worked. Could it be that there is some
>                     load balancer/cache in
>                     >> front of the archive and some nodes still serve
>                     the corrupt packages?
>                     >>
>                     >> On Fri, Mar 18, 2016 at 8:00 AM, Nicholas Chammas
>                     >> <nicholas.chammas@gmail.com
>                     <mailto:nicholas.chammas@gmail.com>> wrote:
>                     >> > I'm seeing the same. :(
>                     >> >
>                     >> > On Fri, Mar 18, 2016 at 10:57 AM Ted Yu
>                     <yuzhihong@gmail.com <mailto:yuzhihong@gmail.com>>
>                     wrote:
>                     >> >>
>                     >> >> I tried again this morning :
>                     >> >>
>                     >> >> $ wget
>                     >> >>
>                     >> >>
>                     https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoop2.6.tgz
>                     >> >> --2016-03-18 07:55:30--
>                     >> >>
>                     >> >>
>                     https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoop2.6.tgz
>                     >> >> Resolving s3.amazonaws.com... 54.231.19.163
>                     >> >> ...
>                     >> >> $ tar zxf spark-1.6.1-bin-hadoop2.6.tgz
>                     >> >>
>                     >> >> gzip: stdin: unexpected end of file
>                     >> >> tar: Unexpected EOF in archive
>                     >> >> tar: Unexpected EOF in archive
>                     >> >> tar: Error is not recoverable: exiting now
>                     >> >>
>                     >> >> On Thu, Mar 17, 2016 at 8:57 AM, Michael
>                     Armbrust
>                     >> >> <michael@databricks.com
>                     <mailto:michael@databricks.com>>
>                     >> >> wrote:
>                     >> >>>
>                     >> >>> Patrick reuploaded the artifacts, so it
>                     should be fixed now.
>                     >> >>>
>                     >> >>> On Mar 16, 2016 5:48 PM, "Nicholas Chammas"
>                     >> >>> <nicholas.chammas@gmail.com
>                     <mailto:nicholas.chammas@gmail.com>>
>                     >> >>> wrote:
>                     >> >>>>
>                     >> >>>> Looks like the other packages may also
be
>                     corrupt. I’m getting the
>                     >> >>>> same
>                     >> >>>> error for the Spark 1.6.1 / Hadoop 2.4
>                     package.
>                     >> >>>>
>                     >> >>>>
>                     >> >>>>
>                     >> >>>>
>                     https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoop2.4.tgz
>                     >> >>>>
>                     >> >>>> Nick
>                     >> >>>>
>                     >> >>>>
>                     >> >>>> On Wed, Mar 16, 2016 at 8:28 PM Ted Yu
>                     <yuzhihong@gmail.com <mailto:yuzhihong@gmail.com>>
>                     wrote:
>                     >> >>>>>
>                     >> >>>>> On Linux, I got:
>                     >> >>>>>
>                     >> >>>>> $ tar zxf spark-1.6.1-bin-hadoop2.6.tgz
>                     >> >>>>>
>                     >> >>>>> gzip: stdin: unexpected end of file
>                     >> >>>>> tar: Unexpected EOF in archive
>                     >> >>>>> tar: Unexpected EOF in archive
>                     >> >>>>> tar: Error is not recoverable: exiting
now
>                     >> >>>>>
>                     >> >>>>> On Wed, Mar 16, 2016 at 5:15 PM, Nicholas
>                     Chammas
>                     >> >>>>> <nicholas.chammas@gmail.com
>                     <mailto:nicholas.chammas@gmail.com>> wrote:
>                     >> >>>>>>
>                     >> >>>>>>
>                     >> >>>>>>
>                     >> >>>>>>
>                     https://s3.amazonaws.com/spark-related-packages/spark-1.6.1-bin-hadoop2.6.tgz
>                     >> >>>>>>
>                     >> >>>>>> Does anyone else have trouble unzipping
>                     this? How did this happen?
>                     >> >>>>>>
>                     >> >>>>>> What I get is:
>                     >> >>>>>>
>                     >> >>>>>> $ gzip -t spark-1.6.1-bin-hadoop2.6.tgz
>                     >> >>>>>> gzip: spark-1.6.1-bin-hadoop2.6.tgz:
>                     unexpected end of file
>                     >> >>>>>> gzip: spark-1.6.1-bin-hadoop2.6.tgz:
>                     uncompress failed
>                     >> >>>>>>
>                     >> >>>>>> Seems like a strange type of problem
to
>                     come across.
>                     >> >>>>>>
>                     >> >>>>>> Nick
>                     >> >>>>>
>                     >> >>>>>
>                     >> >>
>                     >> >
>
>


Mime
View raw message