flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4777) ContinuousFileMonitoringFunction may throw IOException when files are moved
Date Mon, 10 Oct 2016 09:03:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561712#comment-15561712
] 

ASF GitHub Bot commented on FLINK-4777:
---------------------------------------

Github user mxm commented on the issue:

    https://github.com/apache/flink/pull/2610
  
    Thanks, merged to `release-1.1` and `master`.


> ContinuousFileMonitoringFunction may throw IOException when files are moved
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-4777
>                 URL: https://issues.apache.org/jira/browse/FLINK-4777
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming Connectors
>    Affects Versions: 1.2.0, 1.1.2
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>            Priority: Critical
>             Fix For: 1.2.0, 1.1.3
>
>
> FileSystem.listStatus(path) may throw an IOException when it lists files and then retrieves
their file status. This is quite common, e.g. editors which create temporary files and move
them. The ContinuousFileMonitoringFunction can only apply a file path filter afterwards. Thus,
this problem can't easily be avoided and needs to be taken care of by the function itself.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message