spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Risberg <trisb...@pivotal.io>
Subject Re: Integrating Spark with other applications
Date Fri, 07 Nov 2014 22:58:56 GMT
Hi,

I'm a committer on that spring-hadoop project and I'm also interested in
integrating Spark with other Java applications. I would love to see some
guidance from the Spark community for the best way to accomplish this. We
have plans to add features to work with Spark Apps in similar ways we now
support Hive and Pig jobs in the spring-hadoop project. In fact, I added a
spring-hadoop-spark sub-project earlier, but there is no real code there
yet. Hoping to get this added soon, so some helpful pointers would be great.

-Thomas

[1]
https://github.com/spring-projects/spring-hadoop/tree/master/spring-hadoop-spark/src/main/java/org/springframework/data/hadoop/spark

On Fri, Nov 7, 2014 at 5:42 PM, gtinside <gtinside@gmail.com> wrote:

> Hi ,
>
> I have been working on Spark SQL and want to expose this functionality to
> other applications. Idea is to let other applications to send sql to be
> executed on spark cluster and get the result back. I looked at spark job
> server (https://github.com/ooyala/spark-jobserver) but it provides a
> RESTful
> interface. I am looking for something similar as
> spring-hadoop(http://projects.spring.io/spring-hadoop/) to do a
> spark-submit
> programmatically.
>
> Regards,
> Gaurav
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Integrating-Spark-with-other-applications-tp18383.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message