kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marko Bonaći <marko.bon...@sematext.com>
Subject Re: Not able to run multiple consumer instances
Date Fri, 29 Apr 2016 11:11:27 GMT
Yes, a partition can be accessed by only a single thread at a time, so that
second consumer of yours, since it's in the same group, has nothing to do.
If you add more partitions your consumers would help each other consume all
messages out of that topic (roughly 50% of messages each).
If you were to assign the second consumer with a different group, each
consumer would consume all messages (independently of one another).

BTW, Kafka is not broadcasting anything, your consumers are pulling
messages out of Kafka :)

Marko Bonaći
Monitoring | Alerting | Anomaly Detection | Centralized Log Management
Solr & Elasticsearch Support
Sematext <http://sematext.com/> | Contact
<http://sematext.com/about/contact.html>

On Fri, Apr 29, 2016 at 12:18 PM, paresh <pareshb@glam.com> wrote:

> Hi Team,
>
> Can anybody help with issue I am facing with running multiple consumer
> instances on single topic having single partition?
>
> Kafka is broadcasting messages to all the consumers though all consumers
> are running in same group
> I am using kafka-php client lib to connect with kafka server and using
> socket connect (Encoder/Decoder) for connecting consumer and producer.
>
> Regards,
> Paresh Behede
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message