spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-3957) Broadcast variable memory usage not reflected in UI
Date Mon, 20 Oct 2014 03:13:36 GMT

    [ https://issues.apache.org/jira/browse/SPARK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176567#comment-14176567
] 

Apache Spark commented on SPARK-3957:
-------------------------------------

User 'CodingCat' has created a pull request for this issue:
https://github.com/apache/spark/pull/2851

> Broadcast variable memory usage not reflected in UI
> ---------------------------------------------------
>
>                 Key: SPARK-3957
>                 URL: https://issues.apache.org/jira/browse/SPARK-3957
>             Project: Spark
>          Issue Type: Bug
>          Components: Block Manager, Web UI
>    Affects Versions: 1.0.2, 1.1.0
>            Reporter: Shivaram Venkataraman
>            Assignee: Nan Zhu
>
> Memory used by broadcast variables are not reflected in the memory usage reported in
the WebUI. For example, the executors tab shows memory used in each executor but this number
doesn't include memory used by broadcast variables. Similarly the storage tab only shows list
of rdds cached and how much memory they use.  
> We should add a separate column / tab for broadcast variables to make it easier to debug.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message