flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andy (Jira)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-22805) Dynamic configuration of Flink checkpoint interval
Date Mon, 31 May 2021 03:52:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354205#comment-17354205
] 

Andy commented on FLINK-22805:
------------------------------

[~okowr] , thanks for describe the requirement. 

I paste the user mail list here to easy to track: [http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Dynamic-configuration-of-Flink-checkpoint-interval-td44059.html]

And add a related Jira (https://issues.apache.org/jira/browse/FLINK-18578) which is given
by [~renqs].

> Dynamic configuration of Flink checkpoint interval
> --------------------------------------------------
>
>                 Key: FLINK-22805
>                 URL: https://issues.apache.org/jira/browse/FLINK-22805
>             Project: Flink
>          Issue Type: New Feature
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.13.1
>            Reporter: Fu Kai
>            Priority: Critical
>             Fix For: 1.14.0
>
>
> Flink currently does not support dynamic configuration of checkpoint interval on the
fly. It's useful for use cases like backfill/cold-start from a stream containing whole history.
>  
> In the cold-start phase, resources are fully utilized and the back-pressure is high for
all upstream operators, causing the checkpoint timeout constantly. The real production traffic
is far less than that and the provisioned resource is capable of handling it. 
>  
> With the dynamic checkpoint interval configuration, the cold-start process can be speeded
up with less frequent checkpoint interval or even turned off. After the process is completed,
the checkpoint interval can be updated to normal.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message