flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yingjie Cao (Jira)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-14818) StreamNetworkBenchmarkEnvironment incorrectly setups a receiving InputGate
Date Thu, 21 Nov 2019 12:04:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979219#comment-16979219

Yingjie Cao commented on FLINK-14818:

I found there seems no very straightforward way to achieve our goal of 4 ResultPartition with
1000 subpartition each to 4 SingleInputGate which 1000 input channel each. The reason is that
the subpartition index to be request is InputGate level not InputChannel level, each time
when requesting a subpartition, the InputGate passes the subpartition index to InputChannel,
so the requested subpartition indexes are all the same one for all InputChannels of a InputGate.
If we want to change the behavior and without touching the non-test-code, we may need to mock
a InputGate and relevant code to change the behavior. Do you think that is acceptable? [~pnowojski]

> StreamNetworkBenchmarkEnvironment incorrectly setups a receiving InputGate
> --------------------------------------------------------------------------
>                 Key: FLINK-14818
>                 URL: https://issues.apache.org/jira/browse/FLINK-14818
>             Project: Flink
>          Issue Type: Bug
>          Components: Benchmarks
>    Affects Versions: 1.7.2, 1.8.2, 1.9.1
>            Reporter: Piotr Nowojski
>            Assignee: Yingjie Cao
>            Priority: Major
> In network benchmark (for example 1000 channels benchmark with 4 record writers) {{StreamNetworkBenchmarkEnvironment#createInputGate}}
creates 1000 input gates with 4 input channels each, which doesn't make much sense. I would
expect either having 4 receivers with single input gate with 1000 channels each, or a single
receiver with 4 input gates, with 1000 channels each.

This message was sent by Atlassian Jira

View raw message