spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shuai Zheng" <szheng.c...@gmail.com>
Subject RE: Determine number of running executors
Date Fri, 16 Jan 2015 18:05:12 GMT
Hi Tobias,

 

Can you share more information about how do you do that? I also have similar question about
this.

 

Thanks a lot,

 

Regards,

 

Shuai

 

From: Tobias Pfeiffer [mailto:tgp@preferred.jp] 
Sent: Wednesday, November 26, 2014 12:25 AM
To: Sandy Ryza
Cc: Yanbo Liang; user
Subject: Re: Determine number of running executors

 

Hi,

 

Thanks for your help!

 

Sandy, I had a bit of trouble finding the spark.executor.cores property. (It wasn't there
although its value should have been 2.)

I ended up throwing regular expressions on scala.util.Properties.propOrElse("sun.java.command",
""), which worked surprisingly well ;-)

 

Thanks

Tobias

 


Mime
View raw message