spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luca Canali (Jira)" <>
Subject [jira] [Updated] (SPARK-30041) Add Codegen Stage Id to Stage DAG visualization in Web UI
Date Wed, 04 Dec 2019 12:40:00 GMT


Luca Canali updated SPARK-30041:
    Attachment:     (was: Snippet_StagesDags_with_CodegenId.png)

> Add Codegen Stage Id to Stage DAG visualization in Web UI
> ---------------------------------------------------------
>                 Key: SPARK-30041
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL, Web UI
>    Affects Versions: 3.0.0
>            Reporter: Luca Canali
>            Priority: Minor
>         Attachments: Snippet_StagesDags_with_CodegenId _annotated.png
> SPARK-29894 provides information on the Codegen Stage Id in WEBUI for SQL Plan graphs.
Similarly, this proposes to add Codegen Stage Id in the DAG visualization for Stage execution.
DAGs for Stage execution are available in the WEBUI under the Jobs and Stages tabs.
>  This is proposed as an aid for drill-down analysis of complex SQL statement execution,
as it is not always easy to match parts of the SQL Plan graph with the corresponding Stage
DAG execution graph. Adding Codegen Stage Id for WholeStageCodegen operations makes this task

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message