kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dor Ben Dov <dor.ben-...@amdocs.com>
Subject RE: backup
Date Sun, 09 Aug 2020 11:55:27 GMT
Hi Liam, 
No actual problem just wondering, still you answered most of the things I already know so
no I am convinced that I am ok. 
Still, wondering about the mmk2. How reliable is it, have you used it in production for instance?

Regards,
Dor

-----Original Message-----
From: Liam Clarke-Hutchinson <liam.clarke@adscale.co.nz> 
Sent: Sunday, August 9, 2020 2:52 PM
To: users@kafka.apache.org
Subject: Re: backup

Hi Dor,

There are multiple approaches.

1) Clone your Kafka broker volumes
2) Use Kafka Connect to stream all data to a different storage system such as Hadoop, S3,
etc.
3) Use Mirrormaker to replicate all data to a backup cluster.

Which approach is right for you really depends on your needs, but generally, if you have enough
nodes in your clusters, and a correct replication setting for a topic, you won't need to backup
Kafka. As a rule of thumb, a topic with a replication factor of N can survive N - 1 node failures
without data loss.

If you can provide more information about the problems you're trying to solve, our advice
can be more directed :)

Kind regards,

Liam Clarke-Hutchinson

On Sun, Aug 9, 2020 at 11:43 PM Dor Ben Dov <dor.ben-dov@amdocs.com> wrote:

> Hi All,
> What is the best recommended way, and tool to backup kafka in production?
> Regards,
> Dor
>
> This email and the information contained herein is proprietary and 
> confidential and subject to the Amdocs Email Terms of Service, which 
> you may review at 
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.
> amdocs.com%2Fabout%2Femail-terms-of-service&amp;data=02%7C01%7Cdor.ben
> -dov%40amdocs.com%7C41b5e7ba2ac947d8f92208d83c5ac7c3%7Cc8eca3ca127646d
> 59d9da0f2a028920f%7C0%7C0%7C637325707889579052&amp;sdata=jXXwnZCqI5bjQ
> 8beZTR8WM7l1yhEPkuSQJ%2FMqfJlz00%3D&amp;reserved=0 < 
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.
> amdocs.com%2Fabout%2Femail-terms-of-service&amp;data=02%7C01%7Cdor.ben
> -dov%40amdocs.com%7C41b5e7ba2ac947d8f92208d83c5ac7c3%7Cc8eca3ca127646d
> 59d9da0f2a028920f%7C0%7C0%7C637325707889579052&amp;sdata=jXXwnZCqI5bjQ
> 8beZTR8WM7l1yhEPkuSQJ%2FMqfJlz00%3D&amp;reserved=0>
>
>
This email and the information contained herein is proprietary and confidential and subject
to the Amdocs Email Terms of Service, which you may review at https://www.amdocs.com/about/email-terms-of-service
<https://www.amdocs.com/about/email-terms-of-service>


Mime
View raw message