spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sujeet jog <sujeet....@gmail.com>
Subject Re: Spark jobs
Date Wed, 29 Jun 2016 13:51:00 GMT
check if this helps,

from multiprocessing import Process

def training() :
        print ("Training Workflow")

        cmd = spark/bin/spark-submit  ./ml.py & "
        os.system(cmd)

w_training      = Process(target = training)



On Wed, Jun 29, 2016 at 6:28 PM, Joaquin Alzola <Joaquin.Alzola@lebara.com>
wrote:

> Hi,
>
>
>
> This is a totally newbie question but I seem not to find the link ….. when
> I create a spark-submit python script to be launch …
>
>
>
> how should I call it from the main python script with a subprocess.popen?
>
>
>
> BR
>
>
>
> Joaquin
>
>
>
>
>
>
>
>
>
>
>
>
> This email is confidential and may be subject to privilege. If you are not
> the intended recipient, please do not copy or disclose its content but
> contact the sender immediately upon receipt.
>

Mime
View raw message