kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Sites <Eric.Si...@threattrack.com>
Subject Re: multiple queue consumers on one partition
Date Thu, 15 Aug 2013 04:14:42 GMT
Yes, that is the expected.


You need more partitions per topic, at lest 1 partition per consumer in
the group.

So if you have n consumers you need n topics.

All messages sent to the topic will be divided amongst the partitions.

Cheers,
Eric Sites

On 8/14/13 3:59 PM, "Wu, Jiang2 " <jiang2.wu@citi.com> wrote:

>Hi,
>
>In our experiments, we find that if multiple consumers in the same group
>listen to the same partition, then one consumer will receive all messages
>on this partition, and others get none. Is this inherent to Kafka design,
>or it can be changed by some configuration? Basically we expect ems queue
>behavior, i.e., each of the n consumers receive about 1/n of the total
>messages.
>
>Thanks,
>Jiang
>


Mime
View raw message