flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From " Mario Georgiev (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-12172) Flink fails to close pending BucketingSink
Date Fri, 12 Apr 2019 14:34:00 GMT
 Mario Georgiev created FLINK-12172:

             Summary: Flink fails to close pending BucketingSink
                 Key: FLINK-12172
                 URL: https://issues.apache.org/jira/browse/FLINK-12172
             Project: Flink
          Issue Type: Bug
    Affects Versions: 1.7.2
            Reporter:  Mario Georgiev


The problem is if you have a BucketingSink, the following case may occur :

Let's say you have a 2019-04-12–12 bucket created with several files inside which are pending/finished
You create a savepoint and shut down the job
After an hour for instance you start the job from the savepoint and a new bucket is created,
2019-04-16 for instance. 
The problem is that the .pending ones from the old buckets seem to never be moved to finished

This message was sent by Atlassian JIRA

View raw message