flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chesnay Schepler (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-6947) Warn user when assigning timestamps/watermarks after a union
Date Tue, 20 Jun 2017 13:03:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-6947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chesnay Schepler updated FLINK-6947:
------------------------------------
    Summary: Warn user when assigning timestamps/watermarks after a union  (was: Warn on )

> Warn user when assigning timestamps/watermarks after a union
> ------------------------------------------------------------
>
>                 Key: FLINK-6947
>                 URL: https://issues.apache.org/jira/browse/FLINK-6947
>             Project: Flink
>          Issue Type: Improvement
>          Components: DataStream API
>    Affects Versions: 1.3.0, 1.2.1
>            Reporter: Petr Novotnik
>            Priority: Minor
>
> Placing timestamp assignment (and watermark generation) directly or indirectly after
a union is generally not desirable as it may lead to surprising results at the client side.
Ideally, timestamp assignment (and watermark generation) is best placed as close as possible
to the data sources.  It would be nice to generate a warning to the user (i.e. to the log)
before job execution if the framework detects timestamp assignment (directly or indirectly
placed) after a union.
> Some more background information for this issue can be found in this email thread: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/union-followed-by-timestamp-assignment-watermark-generation-td13036.html



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message