kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shivam Sharma <28shivamsha...@gmail.com>
Subject Need broker side property which can restrict a fetch.size
Date Tue, 09 Jan 2018 11:49:50 GMT

We are having Kafka cluster( of 3 Machines. When we increase
*max.fetch.size.per.partition* to around 50 MB for topic having 48
partition, our Kafka Broker is getting OOM.

As our cluster has many consumers, so restricting fetch size on consumer
side is very difficult which is continuously leading to OOM like issues as
consumer has power to do this.

Anything can be done on broker side to avoid these issues by restricting


Shivam Sharma
Data Engineer @ Goibibo
Indian Institute Of Information Technology, Design and Manufacturing
Mobile No- (+91) 8882114744
Email:- 28shivamsharma@gmail.com

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message