spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Russell Spitzer <russell.spit...@gmail.com>
Subject Re: Where do the executors get my app jar from?
Date Fri, 14 Aug 2020 04:01:55 GMT
The driver hosts a file server which the executors download the jar from.

On Thu, Aug 13, 2020, 5:33 PM James Yu <james@ispot.tv> wrote:

> Hi,
>
> When I spark submit a Spark app with my app jar located in S3, obviously
> the Driver will download the jar from the s3 location.  What is not clear
> to me is: where do the Executors get the jar from?  From the same s3
> location, or somehow from the Driver, or they don't need the jar?
>
> Thanks in advance for explanation.
>
> James
>

Mime
View raw message