spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ZhongYu (Jira)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-30092) Number of active tasks is negative in Live UI Executors page
Date Tue, 10 Dec 2019 10:24:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-30092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16992401#comment-16992401
] 

ZhongYu commented on SPARK-30092:
---------------------------------

It is hard to give steps that will certainly reproduce this issues. But I use this step to
reproduce this issues with relatively large probability.
 # Deploy yarn using AWS ec2 ( or other virtual machine )
 # Start spark job on yarn in client mode.
 # Stop some yarn ec2 slaves that spark job are running 

> Number of active tasks is negative in Live UI Executors page
> ------------------------------------------------------------
>
>                 Key: SPARK-30092
>                 URL: https://issues.apache.org/jira/browse/SPARK-30092
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>    Affects Versions: 2.4.1
>         Environment: Hadoop version: 2.7.3
> ResourceManager version: 2.7.3
>            Reporter: ZhongYu
>            Priority: Major
>         Attachments: WX20191202-102201@2x.png
>
>
> The number of active tasks is negative in Live UI Executors page when there is executor
lost and task failure. I am using spark on yarn which built on AWS spot instances. When yarn
work lost, there is a large probability to become negative active tasks in Spark Live UI.  
> I saw related tickets below and resolved in earlier version of Spark. But Same things
happened again in Spark 2.4.1. See attachment.
> https://issues.apache.org/jira/browse/SPARK-8560
> https://issues.apache.org/jira/browse/SPARK-10141
> https://issues.apache.org/jira/browse/SPARK-19356



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message