kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Péter Sinóros-Szabó <peter.sinoros-sz...@transferwise.com.INVALID>
Subject MM2 startup delay
Date Mon, 09 Dec 2019 11:28:24 GMT
Hi,

I am experimenting with Mirror Make 2 in 2.4.0-rc3. It seems to start up
fine, connects to both source and destination, creates new topics...
But it does not start to actually mirror the messages until about 12
minutes after MM2 was started. I would expect it to start mirroring in some
seconds after startup.

Source cluster has about 2800 partitions, destination cluster is empty.
Both clusters are in AWS but in different regions.

What may cause the 12 minutes delay?

Config is:
---
clusters = eucmain, euwbackup
eucmain.bootstrap.servers =
test-kafka-main-fra01.xx:9092,test-kafka-main-fra02.xx:9092
euwbackup.bootstrap.servers = 172.30.197.203:9092,172.30.213.104:9092
eucmain->euwbackup.enabled = true
eucmain->euwbackup.topics = .*
eucmain->euwbackup.topics.blacklist = ^(kafka|kmf|__).*
eucmain->euwbackup.rename.topics = false
replication.policy.separator = __
eucmain.client.id = mm2

I do not see any serious errors in the logs that I would think of a cause
of this.

Thanks,
Peter

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message