spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zenglong chen <>
Subject Can pyspark use --archives to upload self-defined module than --py-files?
Date Thu, 25 Jul 2019 09:53:37 GMT
     '--py-files' upload zip files and spark python will import module like
So can i use '--archives' to upload zip file and spark worker
python will import like ''./a/module/xx“?
What is the difference between '--py-files' and '--archives' to
upload self-defined module?
Thanks for answer!

View raw message