flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aljoscha Krettek (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-3659) Add ConnectWithBroadcast Operation
Date Tue, 01 Nov 2016 10:03:58 GMT

     [ https://issues.apache.org/jira/browse/FLINK-3659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aljoscha Krettek updated FLINK-3659:
------------------------------------
    Description: 
We should add a new operation that has a main input that can be keyed (but doesn't have to
be) and a second input that is always broadcast. This is similar to a {{CoFlatMap}} or {{CoMap}}
but there either both inputs have to be keyed or non-keyed.

This builds on 
This new operation would allow expressing new patterns that cannot be expressed with the currently
expressed operations.

  was:
Currently, we only allow partitioned state when both inputs are keyed (with the same key type).
I think a valid use case is to have only one side keyed and have the other side broadcast
to publish some updates that are relevant for all keys.

When relaxing the requirement to have only one side keyed we must still ensure that the same
key is used if both sides are keyed.

[~gyfora] Did you try this with what you're working on?


> Add ConnectWithBroadcast Operation
> ----------------------------------
>
>                 Key: FLINK-3659
>                 URL: https://issues.apache.org/jira/browse/FLINK-3659
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 1.0.0
>            Reporter: Aljoscha Krettek
>            Assignee: Aljoscha Krettek
>
> We should add a new operation that has a main input that can be keyed (but doesn't have
to be) and a second input that is always broadcast. This is similar to a {{CoFlatMap}} or
{{CoMap}} but there either both inputs have to be keyed or non-keyed.
> This builds on 
> This new operation would allow expressing new patterns that cannot be expressed with
the currently expressed operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message