spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From hemant singh <hemant2...@gmail.com>
Subject Re: use spark cluster in java web service
Date Thu, 01 Nov 2018 09:44:25 GMT
Why do't you explore Livy. You can use the Rest API to submit the jobs -
https://community.hortonworks.com/articles/151164/how-to-submit-spark-application-through-livy-rest.html



On Thu, Nov 1, 2018 at 12:52 PM 崔苗(数据与人工智能产品开发部) <0049003208@znv.com>
wrote:

> Hi,
> we want to use spark in our java web service , compute data in spark
> cluster according to request,now we have two probles:
> 1、 how to get sparkSession of remote spark cluster (spark on yarn mode) ,
> we want to keep one sparkSession to execute all data compution;
> 2、how to submit to remote spark cluster in java code instead of
> spark-submit , as we want to execute spark code in reponse server;
>
> Thanks for any replys
> 0049003208
> 0049003208@znv.com
>
> <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=0049003208&uid=0049003208%40znv.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%220049003208%40znv.com%22%5D>
> 签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail81>
定制
>

Mime
View raw message