You can take a look at http://zeppelin.incubator.apache.org. it is a notebook and graphic visual designer.
Thanks, Gaurav and Corey,
Probably I didn’t make myself clear. I am looking for best Spark practice similar to Shiny for R, the analysis/visualziation results can be easily published to web server and shown from web browser. Or any dashboard for Spark?
You can also look at Spark Job Server https://github.com/spark-jobserver/spark-jobserver
On Jan 9, 2015, at 10:25 PM, Corey Nolet <firstname.lastname@example.org> wrote:
The solution largely depends on how you want your services deployed (Java web container, Spray framework, etc...) and if you are using a cluster manager like Yarn or Mesos vs. just firing up your own executors and master.
I recently worked on an example for deploying Spark services inside of Jetty using Yarn as the cluster manager. It forced me to learn how Spark wires up the dependencies/classpaths. If it helps, the example that resulted from my tinkering is located at .
On Fri, Jan 9, 2015 at 9:33 PM, Cui Lin <email@example.com> wrote:
What’s the best practice on deploying/publishing spark-based scientific applications into a web service? Similar to Shiny on R.Thanks!