kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From adrien ruffie <adriennolar...@hotmail.fr>
Subject Choosing topic/partition formula
Date Fri, 02 Mar 2018 09:46:58 GMT
Hi all,

I have a difficulty to represent an example of the calculation of the following formula.

Based on throughput requirements one can pick a rough number of partitions.

  1.  Lets call the throughput from producer to a single partition is P
  2.  Throughput from a single partition to a consumer is C
  3.  Target throughput is T
  4.  Required partitions = Max (T/P, T/C)

In the part Choosing topic/partition of this link:


Could someone explain to me the calculation ? By showing me step by step the calculation,
plz ? I do not remember how the formula applies visually ...

Maths, are so far :-)

Example T = 20MB/S      P = 5MB/S     and  C = 3MB/S

==> Max(20/5, 20/3)  = ???   ==> 20/5 because is the maximum of both ? consequently
I need 4 partitions for my topic ? But it does not also depend of the number of producers
& consumers ?

Thank all.

Best regards,


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message