flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aljoscha Krettek (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9600) Add DataStream transformation variants that pass timestamp to the user function
Date Thu, 12 Jul 2018 09:50:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16541401#comment-16541401

Aljoscha Krettek commented on FLINK-9600:

Did you have a look at {{ProcessFunction}} and the new additions to {{KeyedProcessFunction}}
that allow accessing the key of the object both when processing a record and when processing
a timer? https://github.com/apache/flink/blob/cde504eb401441e589b3f295e40db37a005ee6d9/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/KeyedProcessFunction.java#L52

> Add DataStream transformation variants that pass timestamp to the user function
> -------------------------------------------------------------------------------
>                 Key: FLINK-9600
>                 URL: https://issues.apache.org/jira/browse/FLINK-9600
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 1.5.0
>            Reporter: Elias Levy
>            Priority: Minor
> It is often necessary to access the timestamp assigned to records within user functions.
 At the moment this is only possible from {{RichFunction}}. Implementing a {{RichFunction}}
just to access the timestamp is burdensome, so most job carry a duplicate of the timestamp
within the record.
> It would be useful if {{DataStream}} provided transformation methods that accepted user
functions that could be passed the record's timestamp as an additional argument, similar to
how there are two variants of {{flatMap}}, one with an extra parameter that gives the user
function access to the output {{Collector}}.
> Along similar lines, it may be useful to have variants that pass the record's key as
an additional parameter.

This message was sent by Atlassian JIRA

View raw message