spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From JF Chen <>
Subject how to change temp directory when spark write data ?
Date Wed, 05 Dec 2018 08:11:54 GMT
I have two spark apps writing data to one directory. I notice they share
one temp directory, and the spark fist finish writing will clear the temp
directory and the slower one may throw "No lease on *** File does not
exist" error
So how to specify the temp directory?

Junfeng Chen

View raw message