spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tushar Sudake <etusha...@gmail.com>
Subject EMR: Use extra mounted EBS volumes for spark.local.dir
Date Mon, 09 Oct 2017 01:54:58 GMT
Hello everyone,

I'm using 'r4.8xlarge' instances on EMR for my Spark Application.
To each node, I'm attaching one 512 GB EBS volume.

By logging in into nodes I tried verifying that this volume is being set
for 'spark.local.dir' by EMR automatically, but couldn't find any such
configuration.

Can someone please confirm this? Do I need to do it myself though bootstrap
steps?

Thanks,
Tushar

Mime
View raw message