kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bart Wyatt <bart.wy...@dsvolition.com>
Subject Re: Adding replicas
Date Thu, 17 Sep 2015 13:40:26 GMT
It will pull the available section of the log into the new replica.   In other words, yes it
will copy the "entire" log, where entire respects that the earliest available offset is probably
not 0.

In the case of a compacted log the replicated log may or may not have the same structure (I
think it runs its own compactor on its own schedule) but it should have the same guarantees
of a compacted log, you just might get more/less stale keys when reading it from the beginning
after a leadership change.

From: Scott Thibault <scott.thibault@multiscalehn.com>
Sent: Thursday, September 17, 2015 8:22 AM
To: users@kafka.apache.org
Subject: Adding replicas


If we add a new broker and then assign it as a new replica for a topic,
does the entire log for the topic get copied to that new node or does the
new node just get new data?

--Scott Thibault

*This e-mail is not encrypted.  Due to the unsecured nature of unencrypted
e-mail, there may be some level of risk that the information in this e-mail
could be read by a third party.  Accordingly, the recipient(s) named above
are hereby advised to not communicate protected health information using
this e-mail address.  If you desire to send protected health information
electronically, please contact MultiScale Health Networks at (206)538-6090*

COMMUNICATION intended solely for the recipient and, therefore, may not be retransmitted to
any party outside of the recipient's organization without the prior written consent of the
sender. If you have received this e-mail in error please notify the sender immediately by
telephone or reply e-mail and destroy the original message without making a copy. Deep Silver,
Inc. accepts no liability for any losses or damages resulting from infected e-mail transmissions
and viruses in e-mail attachments.

View raw message