spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gorka Bravo Martinez <gorka.bravo.marti...@cern.ch>
Subject Boto3 library send to pyspark
Date Wed, 17 Apr 2019 07:11:10 GMT
Hi all,

I would like to send a boto/boto3 library while running pyspark with yarn client mode, how
is it possible?
I am aware sc.addFile(<path>) can add a .py file, is it the same for a library?

Cheers, Gorka.

Mime
View raw message