kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Visher <tim.vis...@gmail.com>
Subject Re: Any suggestion about Kafka/Zookeeper migration.
Date Thu, 04 Jan 2018 14:06:09 GMT
On Wed, Jan 3, 2018 at 11:39 PM, Tony Liu <jiangtao.liu@zuora.com> wrote:

> This post here is aimed to ask experience about what did you do migration
> `Kafka/zookeeper` ?  :)
>
>
I think the easiest way to migrate kafka is to do a blue/green deploy.
Stand up an entire new cluster, cut over producers to it, wait for the old
cluster to drain, cut over consumers, then shut down the old cluster.

Especially in AWS or any other virtualized environment this should be very
easy assuming that you don't need to deploy many things to do the cutover.
DNS or some other load balancing solution could help but you may be in too
deep to put that in place now.

As far as migrating zookeeper, you could stand up a new zookeeper cluster
when spinning up your new kafka cluster and do the same thing.

My team is currently doing exactly that right now.

--

In Christ,

Timmy V.

https://blog.twonegatives.com
https://five.sentenc.es

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message