spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Corey Nolet <cjno...@gmail.com>
Subject Re: Web Service + Spark
Date Sat, 10 Jan 2015 03:25:08 GMT
Cui Lin,

The solution largely depends on how you want your services deployed (Java
web container, Spray framework, etc...) and if you are using a cluster
manager like Yarn or Mesos vs. just firing up your own executors and master.

I recently worked on an example for deploying Spark services inside of
Jetty using Yarn as the cluster manager. It forced me to learn how Spark
wires up the dependencies/classpaths. If it helps, the example that
resulted from my tinkering is located at [1].


[1] https://github.com/calrissian/spark-jetty-server

On Fri, Jan 9, 2015 at 9:33 PM, Cui Lin <cui.lin@hds.com> wrote:

>  Hello, All,
>
>  What’s the best practice on deploying/publishing spark-based scientific
> applications into a web service? Similar to Shiny on R.
>  Thanks!
>
>  Best regards,
>
>  Cui Lin
>

Mime
View raw message