flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (Jira)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-14653) Job-related errors in snapshotState do not result in job failure
Date Tue, 26 Nov 2019 17:07:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-14653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982685#comment-16982685
] 

Maximilian Michels commented on FLINK-14653:
--------------------------------------------

I'm not sure this will work because we don't know whether an exception is an application error
or a checkpointing error. I think the best solution is to introduce a new exception which
users can throw to indicate that the error is application related. That way the underlying
operator knows that an unrecoverable error occurred. This is basically solution #1 but more
explicit due to using a checked exception.

> Job-related errors in snapshotState do not result in job failure
> ----------------------------------------------------------------
>
>                 Key: FLINK-14653
>                 URL: https://issues.apache.org/jira/browse/FLINK-14653
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Checkpointing
>            Reporter: Maximilian Michels
>            Priority: Minor
>
> When users override {{snapshoteState}}, they might include logic there which is crucial
for the correctness of their application, e.g. finalizing a transaction and buffering the
results of that transaction, or flushing events to an external store. Exceptions occurring
should lead to failing the job.
> Currently, users must make sure to throw a {{Throwable}} because any {{Exception}} will
be caught by the task and reported as checkpointing error, when it could be an application
error.
> It would be helpful to update the documentation and introduce a special exception that
can be thrown for job-related failures, e.g. {{ApplicationError}} or similar.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message