spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Chen <...@mesosphere.io>
Subject Re: dockerized spark executor on mesos?
Date Thu, 15 Jan 2015 18:17:47 GMT
Just throwing this out here, there is existing PR to add docker support for
spark framework to launch executors with docker image.

https://github.com/apache/spark/pull/3074

Hopefully this will be merged sometime.

Tim

On Thu, Jan 15, 2015 at 9:18 AM, Nicholas Chammas <
nicholas.chammas@gmail.com> wrote:

> The AMPLab maintains a bunch of Docker files for Spark here:
> https://github.com/amplab/docker-scripts
>
> Hasn't been updated since 1.0.0, but might be a good starting point.
>
> On Wed Jan 14 2015 at 12:14:13 PM Josh J <joshjdevl@gmail.com> wrote:
>
>> We have dockerized Spark Master and worker(s) separately and are using it
>>> in
>>> our dev environment.
>>
>>
>> Is this setup available on github or dockerhub?
>>
>> On Tue, Dec 9, 2014 at 3:50 PM, Venkat Subramanian <vsubrama@gmail.com>
>> wrote:
>>
>>> We have dockerized Spark Master and worker(s) separately and are using
>>> it in
>>> our dev environment. We don't use Mesos though, running it in Standalone
>>> mode, but adding Mesos should not be that difficult I think.
>>>
>>> Regards
>>>
>>> Venkat
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://apache-spark-user-list.1001560.n3.nabble.com/dockerized-spark-executor-on-mesos-tp20276p20603.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>>
>>

Mime
View raw message