kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniel Coldham <dani...@wix.com>
Subject Increase partitions and replication of __consumer_offsets
Date Tue, 23 Jun 2015 12:15:24 GMT
Hi all,
I'm using Kafka in production.

My Kafka Config is pretty much vanilla, so (as far as I understand) offsets
are being written to Zookeeper.
As recommended, I want to start writing offsets to Kafka instead of

I was surprised to see that the __consumer_offsets topic already exists.
But let's assume that's ok.
The topic has 50 partitions (which is the default) and a replication factor
of 1. Of course, I only had 1 broker to begin with so it makes sense that
the replication factor is 1 and not 3 (which is the default).
Now that I've added more brokers, I want to increase the number of
partitions to 200 (as recommended) and the replication factor to 3 (also as

I'd like to do this before starting the process of migrating offsets to

What is the best way of increasing the partitions and replication factor of

*Daniel Coldham*

Recommendations taken from:

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message