kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: partition and consumer stream number
Date Mon, 17 Dec 2012 16:39:09 GMT
Currently, partition is the smallest unit that we distribute data among
consumers (in the same consumer group). So, if the # of consumers is larger
than the total number of partitions in a Kafka cluster (across all
brokers), some consumers will never get any data.



On Mon, Dec 17, 2012 at 6:03 AM, 永辉 赵 <zhaoyonghui@gmail.com> wrote:

> Hi all,
> In consumer we use a topic count map to set how many stream we want to
> split
> the topic.
> What's the relation between kafka partition number and consumer stream
> number?
> Seems  stream number should be less or equal to partition number?
> Because if we set stream number bigger than partition number then some
> stream is empty or some partition is split.
> Thanks,
> Yonghui

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message