kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Helin Xiang <xkee...@gmail.com>
Subject how to achieve availability with no data loss when replica = 1?
Date Wed, 10 Dec 2014 16:27:39 GMT

in some topics of our system, the data volumn is so huge that we think
doing extra replica is a waste of disk and network resource( plus the data
is not so important).

firstly, we use 1 replica + ack=0, found when 1 broker is down, the data
would loss 1/n.
then we tried 1 replica + ack=1, and found after 3 tries, the data is still
lost. and when we set the try number large enough, no more data can be
produced to Kafka.

If I did not misunderstand, In 0.7, when 1 broker is down, both producing
and consuming are available with no data loss. I can see the reason why
kafka 0.8 is designed to be different like 0.7.  but is there a way to let
producer of 0.8 act like the behavior in 0.7?  We don't care which part of
data should go to the specific partition, as long as the data goes into the
kafka with no loss.



*Best RegardsXiang Helin*

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message