flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-11320) Support user callback in Kafka sink
Date Fri, 01 Mar 2019 13:03:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-11320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ASF GitHub Bot updated FLINK-11320:
-----------------------------------
    Labels: pull-request-available  (was: )

> Support user callback in Kafka sink
> -----------------------------------
>
>                 Key: FLINK-11320
>                 URL: https://issues.apache.org/jira/browse/FLINK-11320
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / Kafka
>            Reporter: Allen Wang
>            Priority: Major
>              Labels: pull-request-available
>
> We would like to get notified when Flink's Kafka sink successfully produces a message
to the Kafka cluster for message tracing purposes. The callback should be created for the specific
item being produced. Currently this functionality is inside Flink's internal code and not
accessible to the user. 
> This change would allow user to get callback when a message is produced in the sink:
>  * Add a new interface {{UserCallbackFactory}}:
> {code:java}
> public interface UserCallbackFactory<IN> {
>     Callback create(IN next);
> }{code}
>  * Add new constructor in {{FlinkKafkaProducer}} to pass in an optional argument of {{UserCallbackFactory}}
>  * In the  {{FlinkKafkaProducer.invoke}} method, create a user callback given the produced
item and invoke this callback.
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message