ZhongYu created SPARK-30092:
-------------------------------
Summary: Number of active tasks is negative in UI Executors page
Key: SPARK-30092
URL: https://issues.apache.org/jira/browse/SPARK-30092
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 2.4.1
Environment: Hadoop version: 2.7.3
ResourceManager version: 2.7.3
Reporter: ZhongYu
The number of active tasks is negative in UI Executors page when there is executor lost and
task failure. I am using spark on yarn which built on AWS spot instances. When yarn work lost,
there is a large probability to become negative active tasks in Spark UI.
I saw related tickets below and resolved in earlier version of Spark. But Same things happened
again in Spark 2.4.1.
https://issues.apache.org/jira/browse/SPARK-8560
https://issues.apache.org/jira/browse/SPARK-10141
https://issues.apache.org/jira/browse/SPARK-19356
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|