kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From adrien ruffie <adriennolar...@hotmail.fr>
Subject Choosing topic/partition formula
Date Fri, 02 Mar 2018 09:46:58 GMT
Hi all,


I have a difficulty to represent an example of the calculation of the following formula.


Based on throughput requirements one can pick a rough number of partitions.

  1.  Lets call the throughput from producer to a single partition is P
  2.  Throughput from a single partition to a consumer is C
  3.  Target throughput is T
  4.  Required partitions = Max (T/P, T/C)


In the part Choosing topic/partition of this link:

https://community.hortonworks.com/articles/80813/kafka-best-practices-1.html


Could someone explain to me the calculation ? By showing me step by step the calculation,
plz ? I do not remember how the formula applies visually ...

Maths, are so far :-)


Example T = 20MB/S      P = 5MB/S     and  C = 3MB/S


==> Max(20/5, 20/3)  = ???   ==> 20/5 because is the maximum of both ? consequently
I need 4 partitions for my topic ? But it does not also depend of the number of producers
& consumers ?




Thank all.


Best regards,


Adrien



Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message