kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Madhukar Bharti <bhartimadhu...@gmail.com>
Subject How to Setup MirrorMaker in Generalized way
Date Mon, 08 Dec 2014 15:47:39 GMT

I am going to setup Kafka clusters having 3 brokers in Datacenter 1. Topics
can be created time to time. Each topic can have varying partitions mostly
1,10 or 20. Each application might have different partitioning algorithm
that we don't know(let it be hidden from ops team).

We want to setup mirror maker tool in such a way so that, the exact
partitioned data should go to the same partition without knowing the Topics
partition logic and it should be *generalized*. [This should be common for
all Topics.]

*like partition 0 at DataCenter1 should be exact mirror of  partition-0 in

Please suggest me a solution for doing so. If MirrorMaker
<http://kafka.apache.org/documentation.html#basic_ops_mirror_maker> tool
provide any configurations which solve this use-case please let me know.

Madhukar Bharti

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message