kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Konstantine Karantasis <konstant...@confluent.io>
Subject Re: Kafka Producer HA - using Kafka Connect
Date Tue, 16 Jan 2018 05:40:57 GMT
If I understand correctly, and your question refers to general fault
tolerance, the answer is yes, Kafka Connect offers fault tolerance in
distributed mode.

You may start several Connect workers and if a worker running one task with
your single producer fails unexpectedly, then this task will be restarted
in another worker and continue from where it was left off.


On Thu, Nov 30, 2017 at 4:08 PM, sham singh <singh.shammi2016@gmail.com>

> We are looking at implementing Kafka Producer HA ..
> i.e there are 2 producers which can produce the same data ..
> The objective is to have High Availability implemented for the Kafka
> Producer ..
> i.e. if Producer1 goes down, the Producer2 kick starts and produces data
> starting from the offset committed by the Producer1
> Would using Kafka Connect help in this scenario ?
> or a custom solution would have to be built ?
> Appreciate your response on this.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message