spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Chen <...@mesosphere.io>
Subject Re: Spark 1.5 on Mesos
Date Mon, 29 Feb 2016 17:04:45 GMT
No you don't have to run Mesos in docker containers to run Spark in docker
containers.

Once you have Mesos cluster running you can then specfiy the Spark
configurations in your Spark job (i.e:
spark.mesos.executor.docker.image=mesosphere/spark:1.6)
and Mesos will automatically launch docker containers for you.

Tim

On Mon, Feb 29, 2016 at 7:36 AM, Ashish Soni <asoni.learn@gmail.com> wrote:

> Yes i read that and not much details here.
>
> Is it true that we need to have spark installed on each mesos docker
> container ( master and slave ) ...
>
> Ashish
>
> On Fri, Feb 26, 2016 at 2:14 PM, Tim Chen <tim@mesosphere.io> wrote:
>
>> https://spark.apache.org/docs/latest/running-on-mesos.html should be the
>> best source, what problems were you running into?
>>
>> Tim
>>
>> On Fri, Feb 26, 2016 at 11:06 AM, Yin Yang <yy201602@gmail.com> wrote:
>>
>>> Have you read this ?
>>> https://spark.apache.org/docs/latest/running-on-mesos.html
>>>
>>> On Fri, Feb 26, 2016 at 11:03 AM, Ashish Soni <asoni.learn@gmail.com>
>>> wrote:
>>>
>>>> Hi All ,
>>>>
>>>> Is there any proper documentation as how to run spark on mesos , I am
>>>> trying from the last few days and not able to make it work.
>>>>
>>>> Please help
>>>>
>>>> Ashish
>>>>
>>>
>>>
>>
>

Mime
View raw message