spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Romi Kuntsman <r...@totango.com>
Subject diff between apps and waitingApps?
Date Tue, 01 Dec 2015 13:49:59 GMT
Hello,

I'm collecting metrics of master.apps and master.waitingApps, and I see the
values always match.

ref:
https://github.com/apache/spark/blob/branch-1.5/core/src/main/scala/org/apache/spark/deploy/master/Master.scala
https://github.com/apache/spark/blob/branch-1.5/core/src/main/scala/org/apache/spark/deploy/master/MasterSource.scala

What is the meaning of "waitingApps"?
And if the only place it's used is in "startExecutorsOnWorkers" where they
are filtered as "app.coresLeft > 0", shouldn't that also be filtered in the
reported metric?

*Romi Kuntsman*, *Big Data Engineer*
http://www.totango.com

Mime
View raw message