spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dmitry Goldenberg <>
Subject How to tell Spark not to use /tmp for snappy-unknown-***
Date Wed, 30 Sep 2015 12:54:47 GMT
Is there a way to ensure Spark doesn't write to /tmp directory?

We've got spark.local.dir specified in the spark-defaults.conf file to
point at another directory.  But we're seeing many of
these snappy-unknown-*** files being written to /tmp still.

Is there a config setting or something that would cause Spark to use
another directory of our choosing?


View raw message