flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9043) Flink recover from checkpoint like Spark Streaming
Date Wed, 21 Mar 2018 13:15:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16407884#comment-16407884
] 

Stephan Ewen commented on FLINK-9043:
-------------------------------------

When a Flink job starts, you can tell it explicitly to start from a checkpoint (via checkpoint
path) or savepoint.
That gives you the control to do exactly what you describe. In contrast, when starting a job
without and further argument, Flink assumes it is a new job.

Both cases are valid use cases, that's why Flink makes it explicit whether a job starts from
a checkpoint or starts as a new job.

> Flink recover from checkpoint like Spark Streaming 
> ---------------------------------------------------
>
>                 Key: FLINK-9043
>                 URL: https://issues.apache.org/jira/browse/FLINK-9043
>             Project: Flink
>          Issue Type: New Feature
>            Reporter: godfrey johnson
>            Priority: Major
>
> I know a flink job can reovery from checkpoint with restart strategy, but can not recovery
as spark streaming jobs when job is starting.
> Every time, the submitted flink job is regarded as a new job, while , in the spark streaming 
job, which can detect the checkpoint directory first,  and then recovery from the latest
succeed one. However, Flink only can recovery until the job failed first, then retry with
strategy.
>  
> So, would flink support to recover from the checkpoint directly in a new job?
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message