spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-15579) SparkUI: Storage page is empty even if things are cached
Date Fri, 27 May 2016 12:41:12 GMT

    [ https://issues.apache.org/jira/browse/SPARK-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304012#comment-15304012
] 

Sean Owen commented on SPARK-15579:
-----------------------------------

Is the issue that the RDD will be GCed at some point in the near future and will be unpersisted?
that could explain all the behavior here. But that is by design. If you can reproduce it when
holding a ref to it, that's a clear problem.

> SparkUI: Storage page is empty even if things are cached
> --------------------------------------------------------
>
>                 Key: SPARK-15579
>                 URL: https://issues.apache.org/jira/browse/SPARK-15579
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 2.0.0
>            Reporter: Andrew Or
>
> scala> sc.parallelize(1 to 10000, 5000).cache().count()
> SparkUI storage page is empty.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message