spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ranjana Rajendran <>
Subject Does pyspark in cluster mode need python on individual executor nodes ?
Date Tue, 29 Sep 2015 21:08:55 GMT

Does a python spark program (which makes use of pyspark ) submitted in
cluster mode need python on the executor nodes ?  Isn't the python program
interpreted on the client node from where the job is submitted and then the
executors run in the JVM of each the executor nodes ?

Thank you,

View raw message