spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ajith S (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-27012) Storage tab shows rdd details even after executor ended
Date Thu, 28 Feb 2019 13:15:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-27012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780498#comment-16780498
] 

Ajith S commented on SPARK-27012:
---------------------------------

I will be working on this

> Storage tab shows rdd details even after executor ended
> -------------------------------------------------------
>
>                 Key: SPARK-27012
>                 URL: https://issues.apache.org/jira/browse/SPARK-27012
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 2.3.3, 3.0.0
>            Reporter: Ajith S
>            Priority: Major
>
>  
> After we cache a table, we can see its details in Storage Tab of spark UI. If the executor
has shutdown ( graceful shutdown/ Dynamic executor scenario) UI still shows the rdd as cached
and when we click the link it throws error. This is because on executor remove event, we fail
to adjust rdd partition details.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message