spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zenglong chen <czlong.kel...@gmail.com>
Subject spark config about spark.yarn.appMasterEnv
Date Thu, 25 Jul 2019 11:15:55 GMT
Hi all,
       Can spark set worker node environment like linux,eg:
                --conf
 spark.yarn.appMasterEnv.PYTHONPATH=./feature-server:$PYTHONPATH  ?
It is not working like linux shell.
I just want to add a path to PYTHONPATH on worker node rather than cover it.
Thanks for any answer!

Mime
View raw message