flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Piotr Nowojski (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-7684) Avoid multiple data copies in MergingWindowSet
Date Mon, 25 Sep 2017 14:07:00 GMT
Piotr Nowojski created FLINK-7684:

             Summary: Avoid multiple data copies in MergingWindowSet
                 Key: FLINK-7684
                 URL: https://issues.apache.org/jira/browse/FLINK-7684
             Project: Flink
          Issue Type: New Feature
            Reporter: Piotr Nowojski

Currently MergingWindowSet uses ListState of tuples to persists it's mapping. This is inefficient
because this ListState of tuples must be converted to a HashMap on each access.

Furthermore, for some cases it might be inefficient to check whether mapping has changed before
saving it on state.

Those two issues are causing multiple data copies and constructing multiple Lists/Maps per
each processed element, which is a reason for noticeable performance issues.

This message was sent by Atlassian JIRA

View raw message