flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Piotr Nowojski (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (FLINK-7684) Avoid multiple data copies in MergingWindowSet
Date Mon, 25 Sep 2017 14:09:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Piotr Nowojski reassigned FLINK-7684:
-------------------------------------

             Assignee: Piotr Nowojski
    Affects Version/s: 1.2.0
                       1.3.0
                       1.2.1
                       1.3.1
                       1.3.2
          Component/s: Streaming

> Avoid multiple data copies in MergingWindowSet
> ----------------------------------------------
>
>                 Key: FLINK-7684
>                 URL: https://issues.apache.org/jira/browse/FLINK-7684
>             Project: Flink
>          Issue Type: New Feature
>          Components: Streaming
>    Affects Versions: 1.2.0, 1.3.0, 1.2.1, 1.3.1, 1.3.2
>            Reporter: Piotr Nowojski
>            Assignee: Piotr Nowojski
>
> Currently MergingWindowSet uses ListState of tuples to persists it's mapping. This is
inefficient because this ListState of tuples must be converted to a HashMap on each access.
> Furthermore, for some cases it might be inefficient to check whether mapping has changed
before saving it on state.
> Those two issues are causing multiple data copies and constructing multiple Lists/Maps
per each processed element, which is a reason for noticeable performance issues.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message