flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fabian Hueske (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-7193) Update all OVER window ProcessFunction implementations to use SortedQueueState
Date Fri, 14 Jul 2017 09:43:00 GMT
Fabian Hueske created FLINK-7193:
------------------------------------

             Summary: Update all OVER window ProcessFunction implementations to use SortedQueueState
                 Key: FLINK-7193
                 URL: https://issues.apache.org/jira/browse/FLINK-7193
             Project: Flink
          Issue Type: Improvement
          Components: Table API & SQL
    Affects Versions: 1.3.1, 1.4.0
            Reporter: Fabian Hueske


Most OVER windows are implemented as {{ProcessFunction}} with {{MapState}} which is keyed
on a timestamp. The algorithms are implemented in a way that they can leverage a sorted traversal
over the timestamp keys but fall back to sorting if the traversed keys are not sorted.
The {{RocksDBStateBackend}} provides sorted iterators.

FLINK-6219 proposes a {{SortedQueueState}} that guarantees that values can be read from a
sorted list. Once FLINK-6219 is resolved an a {{SortedQueueState}} is available, the OVER
window implementations should be updated to use the new state type instead of {{MapState}}.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message