spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From amit kumar singh <amitiem...@gmail.com>
Subject Re: Can we deploy python script on a spark cluster
Date Thu, 02 Aug 2018 12:50:41 GMT
Hi Lehak

You can make a scala project with oozing class 
And one run class which will ship your python file to cluster 

Define oozie  coordinator with  spark action or shell action

We are deploying pyspark  based machine learning code 


Sent from my iPhone

> On Aug 2, 2018, at 8:46 AM, Lehak Dharmani <lehak.dharmani@intellibridge.co> wrote:
> 
> 
> We are trying to deploy python script on spark cluster . However as per
> documentations , it is not possible to deploy python applications on a
> cluster . Is there any alternative 
> 
> 
> 
> --
> Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
> 
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
> 

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message