kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrey Yegorov <andrey.yego...@gmail.com>
Subject estimating log.retention.bytes
Date Wed, 23 Apr 2014 01:16:32 GMT

Please help me understand how one should estimate upper limit for
log.retention.bytes in this situation.

Let's say kafka cluster has 3 machines (broker per machine) with 15TB disk
space per machine.
Cluster will have one topic with 30 partitions and replication factor 2.

My thinking is:
with replication, I'll have 60 'partitions' spread across 3 machines hence
20 per machine.
Max space I can allocate per partition is 15TB/20 = 768GB per partition.

Am I on the right track?

Andrey Yegorov

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message