flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chesnay Schepler (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-7931) FlinkKinesisProducer violates at-least-once guarantees (1.3 branch)
Date Mon, 13 Aug 2018 08:03:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chesnay Schepler updated FLINK-7931:
------------------------------------
    Fix Version/s:     (was: 1.3.4)

> FlinkKinesisProducer violates at-least-once guarantees (1.3 branch)
> -------------------------------------------------------------------
>
>                 Key: FLINK-7931
>                 URL: https://issues.apache.org/jira/browse/FLINK-7931
>             Project: Flink
>          Issue Type: Bug
>          Components: Kinesis Connector
>            Reporter: Tzu-Li (Gordon) Tai
>            Assignee: Tzu-Li (Gordon) Tai
>            Priority: Blocker
>
> Currently, there is no flushing of KPL outstanding records on checkpoints in the {{FlinkKinesisProducer}}.
Likewise to the at-least-once issue on the Flink Kafka producer before, this may lead to data
loss if there are asynchronous failing records after a checkpoint which the records was part
of was completed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message