spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ZhongYu (Jira)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-30092) Number of active tasks is negative in Live UI Executors page
Date Mon, 02 Dec 2019 04:41:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-30092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ZhongYu updated SPARK-30092:
----------------------------
    Description: 
The number of active tasks is negative in Live UI Executors page when there is executor lost
and task failure. I am using spark on yarn which built on AWS spot instances. When yarn work
lost, there is a large probability to become negative active tasks in Spark Live UI.  

I saw related tickets below and resolved in earlier version of Spark. But Same things happened
again in Spark 2.4.1. See attachment.

https://issues.apache.org/jira/browse/SPARK-8560

https://issues.apache.org/jira/browse/SPARK-10141

https://issues.apache.org/jira/browse/SPARK-19356

  was:
The number of active tasks is negative in UI Executors page when there is executor lost and
task failure. I am using spark on yarn which built on AWS spot instances. When yarn work lost,
there is a large probability to become negative active tasks in Spark UI.  

I saw related tickets below and resolved in earlier version of Spark. But Same things happened
again in Spark 2.4.1. See attachment.

https://issues.apache.org/jira/browse/SPARK-8560

https://issues.apache.org/jira/browse/SPARK-10141

https://issues.apache.org/jira/browse/SPARK-19356


> Number of active tasks is negative in Live UI Executors page
> ------------------------------------------------------------
>
>                 Key: SPARK-30092
>                 URL: https://issues.apache.org/jira/browse/SPARK-30092
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>    Affects Versions: 2.4.1
>         Environment: Hadoop version: 2.7.3
> ResourceManager version: 2.7.3
>            Reporter: ZhongYu
>            Priority: Major
>         Attachments: WX20191202-102201@2x.png
>
>
> The number of active tasks is negative in Live UI Executors page when there is executor
lost and task failure. I am using spark on yarn which built on AWS spot instances. When yarn
work lost, there is a large probability to become negative active tasks in Spark Live UI.  
> I saw related tickets below and resolved in earlier version of Spark. But Same things
happened again in Spark 2.4.1. See attachment.
> https://issues.apache.org/jira/browse/SPARK-8560
> https://issues.apache.org/jira/browse/SPARK-10141
> https://issues.apache.org/jira/browse/SPARK-19356



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message