kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ewen Cheslack-Postava <e...@confluent.io>
Subject Re: Number of concurrent consumers per data node
Date Fri, 05 Feb 2016 08:59:08 GMT
On Wed, Feb 3, 2016 at 3:57 PM, Shane MacPhillamy <shane@blinkmobile.com.au>
wrote:

> Hi
>
> I’m just coming up to speed with Kafka. Some beginner questions, may be
> point me to where I can find the answers please:
>
> 1. In a Kafka cluster what determines the maximum number of concurrent
> consumers that may be connected to a data node?
>

There's not limit imposed by Kafka. Various resource limits (sockets,
bandwidth, etc) will be the limiting factors.


>
> 2. What is a/the scale out strategy for a Kafka cluster when data nodes
> run out of sockets for a consumer to connect to?
>

Currently, the expectation is that you read from a partition leader. The
scale out strategy for a *topic* is to have sufficient partitions, where
partition leaders are spread across many brokers, to support the desired
load.

-Ewen


>
> Thanks.
>
> Cheers, Shane




-- 
Thanks,
Ewen

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message