kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Behrang Saeedzadeh <behran...@gmail.com>
Subject Kafka Connect sink connector in distributed mode: how are records distributed to workers?
Date Mon, 11 Sep 2017 03:40:14 GMT

How does Kafka Connect distribute records between workers for a sink
connector when the connector is only configured to get data from one topic?

* Does it ensure all records in a given partition are sent to the same
worker instance?
* When a new worker is added to the cluster, what steps are taken by
Connect? In particular, if Connect unassigns some partitions from the given
workers and assigns them to this new worker, would it wait for all
in-flight records belonging to these partitions to be processed by the
existing workers?

Best regards,
Behrang Saeedzadeh

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message