spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ofer Eliassaf <ofer.elias...@gmail.com>
Subject Re: RESTful Endpoint and Spark
Date Fri, 07 Oct 2016 04:31:17 GMT
there are 2 main projects for that: livy(https://github.com/cloudera/livy)
and spark job server(https://github.com/spark-jobserver/spark-jobserver).

On Fri, Oct 7, 2016 at 2:27 AM, Benjamin Kim <bbuild11@gmail.com> wrote:

> Has anyone tried to integrate Spark with a server farm of RESTful API
> endpoints or even HTTP web-servers for that matter? I know it’s typically
> done using a web farm as the presentation interface, then data flows
> through a firewall/router to direct calls to a JDBC listener that will
> SELECT, INSERT, UPDATE and, at times, DELETE data in a database. Can the
> same be done using Spark SQL Thriftserver on top of, say, HBase, Kudu,
> Parquet, etc.? Or can Kafka be used somewhere? Spark would be an ideal
> solution as the intermediary because it can talk to any data store
> underneath; so, swapping out a technology at any time would be possible.
>
> Just want some ideas.
>
> Thank,
> Ben
>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>


-- 
Regards,
Ofer Eliassaf

Mime
View raw message