flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-8755) SpilledSubpartitionView wrongly relys on the backlog for determining whether more data is available
Date Thu, 01 Mar 2018 08:20:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16381669#comment-16381669
] 

ASF GitHub Bot commented on FLINK-8755:
---------------------------------------

Github user NicoK commented on the issue:

    https://github.com/apache/flink/pull/5581
  
    alright - test failure is unrelated and appeared separately before (see [FLINK-4387](https://issues.apache.org/jira/browse/FLINK-4387))


> SpilledSubpartitionView wrongly relys on the backlog for determining whether more data
is available
> ---------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-8755
>                 URL: https://issues.apache.org/jira/browse/FLINK-8755
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Network
>            Reporter: Nico Kruber
>            Assignee: Nico Kruber
>            Priority: Blocker
>             Fix For: 1.5.0
>
>
> {code}
> public BufferAndBacklog getNextBuffer() throws IOException, InterruptedException {
> //...
>         int newBacklog = parent.decreaseBuffersInBacklog(current);
>         return new BufferAndBacklog(current, newBacklog > 0, newBacklog, nextBufferIsEvent);
> {code}
> relies on the backlog to signal further data availability. However, if there are only
events left in the buffer queue, their buffers are not included in the backlog counting and
therefore, {{isMoreAvailable}} will be wrongly {{false}} here.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message