flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chesnay Schepler (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4024) FileSourceFunction not adjusted to new IF lifecycle
Date Mon, 06 Jun 2016 19:43:21 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317071#comment-15317071
] 

Chesnay Schepler commented on FLINK-4024:
-----------------------------------------

it also starts the function regardless of whether splitIterator.hasNext() returns true or
false. This may cause issues with NonParallelInputFormats when the parallelism of the FileSourceFunction
is greater than 1.

> FileSourceFunction not adjusted to new IF lifecycle
> ---------------------------------------------------
>
>                 Key: FLINK-4024
>                 URL: https://issues.apache.org/jira/browse/FLINK-4024
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming
>    Affects Versions: 1.1.0
>            Reporter: Chesnay Schepler
>            Priority: Critical
>             Fix For: 1.1.0
>
>
> The InputFormat lifecycle was extended in ac2137cfa5e63bd4f53a4b7669dc591ab210093f, adding
additional open-/closeInputFormat() methods.
> The streaming FileSourceFunction was not adjusted for this change, and thus will fail
for every InputFormat that leverages these new methods.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message