kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joel Koshy <jjkosh...@gmail.com>
Subject Re: partition numbers and mirrormaker
Date Tue, 02 Jul 2013 21:23:27 GMT
You can override the default number of partitions on the source and
target cluster to N. (num.partitions in the broker config). If you
need a higher (or lower) number of partitions for specific topics you
can override that on a per-topic basis (again, the config can be kept
identical between the source and target cluster).



On Tue, Jul 2, 2013 at 1:26 PM, Yu, Libo <libo.yu@citi.com> wrote:
> Hi
> I asked this question previously and didn't get an answer.
> If a topic has N partitions on source cluster, after being mirrored, on the destination
> cluster it has only one partition.
> To avoid this issue, before mirroring, I create the same topic with N partitions on the
> Destination cluster. But then the mirrormaker cannot fetch all partitions and stop
> randomly.
> So what should we expect from mirrormake and what is the right way to use it? Thanks.
> Regards,
> Libo

View raw message