spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jeff saremi <jeffsar...@hotmail.com>
Subject Re: Spark-submit: where do --files go?
Date Thu, 19 Jan 2017 17:56:40 GMT
i wish someone added this to the documentation



________________________________
From: jeff saremi <jeffsaremi@hotmail.com>
Sent: Thursday, January 19, 2017 9:56 AM
To: Sidney Feiner
Cc: user@spark.apache.org
Subject: Re: Spark-submit: where do --files go?


Thanks Sidney


________________________________
From: Sidney Feiner <sidney.feiner@startapp.com>
Sent: Thursday, January 19, 2017 9:52 AM
To: jeff saremi
Cc: user@spark.apache.org
Subject: Re: Spark-submit: where do --files go?


Every executor creates a directory with your submitted files and you can access every file's
absolute path them with the following:

val fullFilePath = SparkFiles.get(fileName)

On Jan 19, 2017 19:35, jeff saremi <jeffsaremi@hotmail.com> wrote:

I'd like to know how -- From within Java/spark -- I can access the dependent files which i
deploy using "--files" option on the command line?


Mime
View raw message