flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2666) Allow custom Timestamp extractors for Flink sources
Date Thu, 01 Oct 2015 16:30:26 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940040#comment-14940040

ASF GitHub Bot commented on FLINK-2666:

Github user aljoscha commented on the pull request:

    Yes, that's why the old interface will be removed. It is not suitable for working with
event-time windows because it does not provide a way of dealing with watermarks. The new one
is basically an extension of the old one but I'm leaving the old API in until the new windowing
API has all functionality.

> Allow custom Timestamp extractors for Flink sources
> ---------------------------------------------------
>                 Key: FLINK-2666
>                 URL: https://issues.apache.org/jira/browse/FLINK-2666
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>            Reporter: Gyula Fora
>            Assignee: Aljoscha Krettek
>            Priority: Minor
> When record timestamps are turned on users currently have 2 ways of specifying record
> They can either chose to automatically attach ingress timestamps (and send watermarks),
or custom implement a sourcefunction to manually assign timestamps and emit watermarks.
> It would be good if users could define a Timestamp extractor function that will attach
a timestamp for every record generated using any of the current Flink sources. Also watermarks
for these records should be automatically generated based on the extracted event time (assuming
monotonicity per source) periodically.

This message was sent by Atlassian JIRA

View raw message