kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Howard <steve.how...@confluent.io>
Subject Re: Kafka memory estimation
Date Fri, 12 Apr 2019 16:43:19 GMT
Hi Rammohan,

How are you measuring "Kafka seems to be reserving most of the memory"?

Thanks,

Steve

On Thu, Apr 11, 2019 at 11:53 PM Rammohan Vanteru <ramz.mohan88@gmail.com>
wrote:

> Hi Users,
>
>  As per the article here:
> https://docs.confluent.io/current/kafka/deployment.html#memory memory
> requirement is roughly calculated based on formula: write throughput*30
> (buffer time in seconds), which fits in our experiment i.e. 30MB/s*30~
> 900MB. Followup questions here:
>
>    - How do we estimate the figure ’30 seconds’ for our buffer time?
>    - Kafka seems to be reserving most of the memory even when the none of
>    the messages are being streamed.. how does that play out.
>
> Any information provided would be helpful.
>
> Thanks,
> Rammohan.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message