spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Ash <and...@andrewash.com>
Subject Re: Updating docs for running on Mesos
Date Tue, 13 May 2014 06:49:26 GMT
I have a draft of my proposed changes here:

https://github.com/apache/spark/pull/756
https://issues.apache.org/jira/browse/SPARK-1818

Thanks!
Andrew


On Mon, May 12, 2014 at 9:57 PM, Andrew Ash <andrew@andrewash.com> wrote:

> As far as I know, the upstream doesn't release binaries, only source code.
>  The downloads page <https://mesos.apache.org/downloads/> for 0.18.0 only
> has a source tarball.  Is there a binary release somewhere from Mesos that
> I'm missing?
>
>
> On Sun, May 11, 2014 at 2:16 PM, Patrick Wendell <pwendell@gmail.com>wrote:
>
>> Andrew,
>>
>> Updating these docs would be great! I think this would be a welcome
>> change.
>>
>> In terms of packaging, it would be good to mention the binaries
>> produced by the upstream project as well, in addition to Mesosphere.
>>
>> - Patrick
>>
>> On Thu, May 8, 2014 at 12:51 AM, Andrew Ash <andrew@andrewash.com> wrote:
>> > The docs for how to run Spark on Mesos have changed very little since
>> > 0.6.0, but setting it up is much easier now than then.  Does it make
>> sense
>> > to revamp with the below changes?
>> >
>> >
>> > You no longer need to build mesos yourself as pre-built versions are
>> > available from Mesosphere: http://mesosphere.io/downloads/
>> >
>> > And the instructions guide you towards compiling your own distribution
>> of
>> > Spark, when you can use the prebuilt versions of Spark as well.
>> >
>> >
>> > I'd like to split that portion of the documentation into two sections, a
>> > build-from-scratch section and a use-prebuilt section.  The new outline
>> > would look something like this:
>> >
>> >
>> > *Running Spark on Mesos*
>> >
>> > Installing Mesos
>> > - using prebuilt (recommended)
>> >  - pointer to mesosphere's packages
>> > - from scratch
>> >  - (similar to current)
>> >
>> >
>> > Connecting Spark to Mesos
>> > - loading distribution into an accessible location
>> > - Spark settings
>> >
>> > Mesos Run Modes
>> > - (same as current)
>> >
>> > Running Alongside Hadoop
>> > - (trim this down)
>> >
>> >
>> >
>> > Does that work for people?
>> >
>> >
>> > Thanks!
>> > Andrew
>> >
>> >
>> > PS Basically all the same:
>> >
>> > http://spark.apache.org/docs/0.6.0/running-on-mesos.html
>> > http://spark.apache.org/docs/0.6.2/running-on-mesos.html
>> > http://spark.apache.org/docs/0.7.3/running-on-mesos.html
>> > http://spark.apache.org/docs/0.8.1/running-on-mesos.html
>> > http://spark.apache.org/docs/0.9.1/running-on-mesos.html
>> >
>> https://people.apache.org/~pwendell/spark-1.0.0-rc3-docs/running-on-mesos.html
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message