spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ofer Eliassaf <>
Subject Re: RESTful Endpoint and Spark
Date Fri, 07 Oct 2016 04:31:17 GMT
there are 2 main projects for that: livy(
and spark job server(

On Fri, Oct 7, 2016 at 2:27 AM, Benjamin Kim <> wrote:

> Has anyone tried to integrate Spark with a server farm of RESTful API
> endpoints or even HTTP web-servers for that matter? I know it’s typically
> done using a web farm as the presentation interface, then data flows
> through a firewall/router to direct calls to a JDBC listener that will
> SELECT, INSERT, UPDATE and, at times, DELETE data in a database. Can the
> same be done using Spark SQL Thriftserver on top of, say, HBase, Kudu,
> Parquet, etc.? Or can Kafka be used somewhere? Spark would be an ideal
> solution as the intermediary because it can talk to any data store
> underneath; so, swapping out a technology at any time would be possible.
> Just want some ideas.
> Thank,
> Ben
> ---------------------------------------------------------------------
> To unsubscribe e-mail:

Ofer Eliassaf

View raw message