spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyukjin Kwon (Jira)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-29450) [SS] In streaming aggregation, metric for output rows is not measured in append mode
Date Thu, 19 Dec 2019 09:24:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-29450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hyukjin Kwon reassigned SPARK-29450:
------------------------------------

    Assignee: Jungtaek Lim

> [SS] In streaming aggregation, metric for output rows is not measured in append mode
> ------------------------------------------------------------------------------------
>
>                 Key: SPARK-29450
>                 URL: https://issues.apache.org/jira/browse/SPARK-29450
>             Project: Spark
>          Issue Type: Bug
>          Components: Structured Streaming
>    Affects Versions: 2.4.4, 3.0.0
>            Reporter: Jungtaek Lim
>            Assignee: Jungtaek Lim
>            Priority: Minor
>
> The bug is reported in dev. mailing list. Credit to [~jlaskowski]. Quoting here:
>  
> {quote}
> I've just noticed that the number of output rows metric of StateStoreSaveExec physical
operator does not seem to be measured for Append output mode. In other words, whatever happens
before or after StateStoreSaveExec operator the metric is always 0.
>  
> It is measured for the other modes - Complete and Update.
> {quote}
> https://lists.apache.org/thread.html/eec318f7ff84c700bffc8bdb7c95c0dcaffb2494ac7ccd7a7c7c6588@%3Cdev.spark.apache.org%3E



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message