spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nan Zhu <zhunanmcg...@gmail.com>
Subject Re: Please help: change $SPARK_HOME/work directory for spark applications
Date Wed, 15 Jan 2014 19:09:23 GMT
Hi, Jin   

It’s SPARK_WORKER_DIR

Line 48 WorkerArguments.scala

if (System.getenv("SPARK_WORKER_DIR") != null) {
    workDir = System.getenv("SPARK_WORKER_DIR")
  }


Best,  

--  
Nan Zhu


On Wednesday, January 15, 2014 at 2:03 PM, Chen Jin wrote:

> Hi,
>  
> Currently my application jars and logs are stored in $SPARK_HOME/work,
> I would like to change it to somewhere having more space. Could anyone
> advise me on this? Changing the log dir is straightforward which just
> to export SPARK_LOG_DIR, however, there is no environment variable for
> SPARK_WORK_DIR.
>  
> Thanks a lot,
>  
> -chen  


Mime
View raw message