kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stevo Slavić <ssla...@gmail.com>
Subject Re: Does MirrorMaker delete topics?
Date Tue, 05 Jan 2016 14:28:22 GMT
Yes, there are quite a few related tickets in JIRA (see here
<https://issues.apache.org/jira/browse/KAFKA-658?jql=project%20%3D%20KAFKA%20AND%20status%20in%20%28Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22%29%20AND%20text%20~%20%22mirror%22>
)

On Tue, Jan 5, 2016 at 3:22 PM, Simon Cooper <
simon.cooper@featurespace.co.uk> wrote:

> Hmm, could this feature be added in the future?
>
> Although a better solution might be to turn mirrormaker into something
> like 'hidden replicas', where a certain set of brokers in a cross-site
> super-cluster replicate topics onto the secondary site but don't take part
> in topic leadership - is this on the cards at all?
>
> Thanks,
> SimonC
>
> -----Original Message-----
> From: Stevo Slavić [mailto:sslavic@gmail.com]
> Sent: 05 January 2016 14:04
> To: users@kafka.apache.org
> Subject: Re: Does MirrorMaker delete topics?
>
> AFAIK "if the right options are set" actually means "if
> auto.create.topics.enable is left to default, set to true". As on any Kafka
> cluster with this configuration option, this will allow implicit topic
> creation, e.g. on first message being published to the topic, if topic does
> not exist it will get created. There are no other guarantees when it comes
> to syncing topic metadata - topic metadata can be completely different e.g.
> different number of partitions, different replica assignment including
> preferred lead, and also topic can get deleted on source and will not be
> deleted on mirror cluster. MirrorMaker only syncs data, not metadata.
>
> Kind regards,
> Stevo Slavic.
>
> On Tue, Jan 5, 2016 at 2:53 PM, Simon Cooper <
> simon.cooper@featurespace.co.uk> wrote:
>
> > Hi all,
> >
> > In the kafka docs, it mentions that MirrorMaker will automatically
> > create topics on the mirror cluster if the right options are set. Does
> > it automatically delete topics on the mirror that are deleted on the
> > main cluster as well?
> >
> > Thanks,
> > SimonC
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message