spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert C Senkbeil <>
Subject Re: Web Service + Spark
Date Mon, 12 Jan 2015 20:45:45 GMT
If you would like to work with an API, you can use the Spark Kernel found

The kernel provides an API following the IPython message protocol as well
as a client library that can be used with Scala applications.

The kernel can also be plugged into the latest developmental version of
IPython 3.0 in case you want to do more visual exploration.

Chip Senkbeil
IBM Emerging Technology Software Engineer

From:	Raghavendra Pandey <>
To:	Cui Lin <>, gtinside <>, Corey
            Nolet <>
Cc:	"" <>
Date:	01/11/2015 02:06 AM
Subject:	Re: Web Service + Spark

You can take a look at it is a
notebook and graphic visual designer.

On Sun, Jan 11, 2015, 01:45 Cui Lin <> wrote:
  Thanks, Gaurav and Corey,

  Probably I didn’t make myself clear. I am looking for best Spark practice
  similar to Shiny for R, the analysis/visualziation results can be easily
  published to web server and shown from web browser. Or any dashboard for

  Best regards,

  Cui Lin

  From: gtinside <>
  Date: Friday, January 9, 2015 at 7:45 PM
  To: Corey Nolet <>
  Cc: Cui Lin <>, "" <>
  Subject: Re: Web Service + Spark

  You can also look at Spark Job Server

  - Gaurav

  On Jan 9, 2015, at 10:25 PM, Corey Nolet <> wrote:

        Cui Lin,

        The solution largely depends on how you want your services deployed
        (Java web container, Spray framework, etc...) and if you are using
        a cluster manager like Yarn or Mesos vs. just firing up your own
        executors and master.

        I recently worked on an example for deploying Spark services inside
        of Jetty using Yarn as the cluster manager. It forced me to learn
        how Spark wires up the dependencies/classpaths. If it helps, the
        example that resulted from my tinkering is located at [1].


        On Fri, Jan 9, 2015 at 9:33 PM, Cui Lin <> wrote:
         Hello, All,

         What’s the best practice on deploying/publishing spark-based
         scientific applications into a web service? Similar to Shiny on R.

         Best regards,

         Cui Lin
View raw message