spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jerry <>
Subject Does the driver program always run local to where you submit the job from?
Date Wed, 26 Aug 2015 21:03:27 GMT
Assuming your submitting the job from terminal; when main() is called, if I
try to open a file locally, can I assume the machine is always the one I
submitted the job from? Currently I'm working off of a single machine, but
I'm wondering if I'll run into issues when I move over to a cluster. The
file I'm opening is purely for the driver program and not something the
worker nodes are going to read from.


View raw message