spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Burak KÖSE (JIRA) <j...@apache.org>
Subject [jira] [Created] (SPARK-28352) Spark UI misses some executor metrics
Date Thu, 11 Jul 2019 16:52:00 GMT
Burak KÖSE created SPARK-28352:
----------------------------------

             Summary: Spark UI misses some executor metrics
                 Key: SPARK-28352
                 URL: https://issues.apache.org/jira/browse/SPARK-28352
             Project: Spark
          Issue Type: Bug
          Components: Web UI
    Affects Versions: 2.4.1
            Reporter: Burak KÖSE


We have recently migrated our application from 2.2.1 to 2.4.1. We have realized that Spark
UI is missing some critical information or shows wrong ones.

We have a big cluster, with 80+ executors. It is Spark Streaming with customer receivers.
On Spark UI in storage tab, we can see memory blocks and their size. This page shows correct
information that we can see on Ganglia and host level monitors. However, in executor tab,
`RDD blocks` shows `0` while we have thousands of them in memory. Moreover, `Storage Memory`
shows incorrect numbers.
 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message