spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saisai Shao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-12552) Recovered driver's resource is not counted in the Master
Date Tue, 29 Dec 2015 09:40:49 GMT
Saisai Shao created SPARK-12552:
-----------------------------------

             Summary: Recovered driver's resource is not counted in the Master
                 Key: SPARK-12552
                 URL: https://issues.apache.org/jira/browse/SPARK-12552
             Project: Spark
          Issue Type: Bug
          Components: Deploy, Spark Core
    Affects Versions: 1.6.0
            Reporter: Saisai Shao


Currently in the implementation of Standalone Master HA, if application is submitted as cluster
mode, the resource (CPU cores and memory) of driver is not counted again when recovered from
failure, which will lead to unexpected behaviors, like more than expected executors, negative
core and memory usage in the web UI. Also the recovered application's state is always {{WAITING}},
we have to change the state to {{RUNNING}} when fully recovered.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message