spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrey Dudin <dudin.and...@gmail.com>
Subject disable spark disk cache
Date Sun, 03 Mar 2019 21:46:58 GMT
Hello everyone,

Is there a way to prevent caching data to disk even if the memory(RAM) runs
out?
As I know, spark will use disk even if I use MEMORY_ONLY. How to disable
this mechanism? I want to get something like out of memory exception if the
memory(RAM) runs out.


Thanks,
Andrey

Mime
View raw message