kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Konstantine Karantasis <konstant...@confluent.io>
Subject Re: Kafka Producer HA - using Kafka Connect
Date Tue, 16 Jan 2018 05:40:57 GMT
If I understand correctly, and your question refers to general fault
tolerance, the answer is yes, Kafka Connect offers fault tolerance in
distributed mode.

You may start several Connect workers and if a worker running one task with
your single producer fails unexpectedly, then this task will be restarted
in another worker and continue from where it was left off.

-Konstantine

On Thu, Nov 30, 2017 at 4:08 PM, sham singh <singh.shammi2016@gmail.com>
wrote:

> We are looking at implementing Kafka Producer HA ..
>
> i.e there are 2 producers which can produce the same data ..
> The objective is to have High Availability implemented for the Kafka
> Producer ..
>
> i.e. if Producer1 goes down, the Producer2 kick starts and produces data
> starting from the offset committed by the Producer1
>
> Would using Kafka Connect help in this scenario ?
> or a custom solution would have to be built ?
>
> Appreciate your response on this.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message