kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bryan Baugher <bjb...@gmail.com>
Subject Kafka Cluster Upgrade/Migration
Date Tue, 03 Mar 2015 21:58:09 GMT
Hi everyone,

I'm starting to look at how you might upgrade your cluster even if a major
upgrade with non-passive API changes and do this all in uptime (i.e. do not
read/write). I realize this may involve knowledge in how Kafka is used, in
our case we own all the reading and writing for now.

Has anyone done this? What tools if any did you use? What was the general
idea?

If Kafka did make non-passive changes can we expect mirror maker or some
migration tool equivalent?

Has anyone tried the confluent REST proxy? Are there any clients for it?

Adding or removing a broker from a cluster seems likely in this case. The
re-assign partitions command seems like it can do it and may support
generating the partition assignments via topics-to-move-json-file and
broker-list options. Has anyone done this? Would this work for
adding/removing brokers from a cluster?

Bryan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message