flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andy (Jira)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-22805) Dynamic configuration of Flink checkpoint interval
Date Mon, 31 May 2021 03:52:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354205#comment-17354205

Andy commented on FLINK-22805:

[~okowr] , thanks for describe the requirement. 

I paste the user mail list here to easy to track: [http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Dynamic-configuration-of-Flink-checkpoint-interval-td44059.html]

And add a related Jira (https://issues.apache.org/jira/browse/FLINK-18578) which is given
by [~renqs].

> Dynamic configuration of Flink checkpoint interval
> --------------------------------------------------
>                 Key: FLINK-22805
>                 URL: https://issues.apache.org/jira/browse/FLINK-22805
>             Project: Flink
>          Issue Type: New Feature
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.13.1
>            Reporter: Fu Kai
>            Priority: Critical
>             Fix For: 1.14.0
> Flink currently does not support dynamic configuration of checkpoint interval on the
fly. It's useful for use cases like backfill/cold-start from a stream containing whole history.
> In the cold-start phase, resources are fully utilized and the back-pressure is high for
all upstream operators, causing the checkpoint timeout constantly. The real production traffic
is far less than that and the provisioned resource is capable of handling it. 
> With the dynamic checkpoint interval configuration, the cold-start process can be speeded
up with less frequent checkpoint interval or even turned off. After the process is completed,
the checkpoint interval can be updated to normal.

This message was sent by Atlassian Jira

View raw message