spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luca Canali (Jira)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-30041) Add Codegen Stage Id to Stage DAG visualization in Web UI
Date Wed, 04 Dec 2019 12:40:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-30041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Luca Canali updated SPARK-30041:
--------------------------------
    Attachment:     (was: Snippet_StagesDags_with_CodegenId.png)

> Add Codegen Stage Id to Stage DAG visualization in Web UI
> ---------------------------------------------------------
>
>                 Key: SPARK-30041
>                 URL: https://issues.apache.org/jira/browse/SPARK-30041
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL, Web UI
>    Affects Versions: 3.0.0
>            Reporter: Luca Canali
>            Priority: Minor
>         Attachments: Snippet_StagesDags_with_CodegenId _annotated.png
>
>
> SPARK-29894 provides information on the Codegen Stage Id in WEBUI for SQL Plan graphs.
Similarly, this proposes to add Codegen Stage Id in the DAG visualization for Stage execution.
DAGs for Stage execution are available in the WEBUI under the Jobs and Stages tabs.
>  This is proposed as an aid for drill-down analysis of complex SQL statement execution,
as it is not always easy to match parts of the SQL Plan graph with the corresponding Stage
DAG execution graph. Adding Codegen Stage Id for WholeStageCodegen operations makes this task
easier.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message