kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "1095193290@qq.com" <1095193...@qq.com>
Subject How to prevent data loss in "read-process-write" application?
Date Mon, 03 Jun 2019 03:22:21 GMT
   I have a application consume from Kafka, process and send to Kafka. In order to prevent
data loss, I need to commit consumer offset after committing a batch of  messages to Kafka
successfully. I investigate Transaction fearture that provided atomic writes to multiple partitions
could  solve my problem. Has any other recommended solution in addition to enable Transcation(
I dont need exactly once process)?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message