spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raghavendra Pandey <raghavendra.pan...@gmail.com>
Subject Re: Can a Spark Driver Program be a REST Service by itself?
Date Wed, 01 Jul 2015 15:31:59 GMT
I am using spark driver as a rest service. I used spray.io to make my app
rest server.

I think this is a good design for applications that you want to keep in
long running mode..
On Jul 1, 2015 6:28 PM, "Arush Kharbanda" <arush@sigmoidanalytics.com>
wrote:

> You can try using Spark Jobserver
>
> https://github.com/spark-jobserver/spark-jobserver
>
> On Wed, Jul 1, 2015 at 4:32 PM, Spark Enthusiast <sparkenthusiast@yahoo.in
> > wrote:
>
>> Folks,
>>
>> My Use case is as follows:
>>
>> My Driver program will be aggregating a bunch of Event Streams and acting
>> on it. The Action on the aggregated events is configurable and can change
>> dynamically.
>>
>> One way I can think of is to run the Spark Driver as a Service where a
>> config push can be caught via an API that the Driver exports.
>> Can I have a Spark Driver Program run as a REST Service by itself? Is
>> this a common use case?
>> Is there a better way to solve my problem?
>>
>> Thanks
>>
>
>
>
> --
>
> [image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>
>
> *Arush Kharbanda* || Technical Teamlead
>
> arush@sigmoidanalytics.com || www.sigmoidanalytics.com
>

Mime
View raw message