kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Santilli <jonathansanti...@gmail.com>
Subject Re: Deciding number of partitions
Date Sun, 11 Nov 2018 15:56:52 GMT
Hello Sachit, I think that's the first question all of us ask our self when
facing that moment, "Ok, but, how many partitions do we need?"

I would say, according to my experience, that directly depends on your
business and the kind of problem you are trying to solve, how many
consumer and producers that topic will have, and so on.

I would recommend reading the blog post "How to choose the number of
topics/partitions in a Kafka cluster
<https://webcache.googleusercontent.com/search?q=cache:Kum1ZTnjfKUJ:https://www.confluent.io/blog/how-choose-number-topics-partitions-kafka-cluster+&cd=1&hl=en&ct=clnk&gl=uk>".
Also, as a general advice, plan ahead your topic configuration and size,
otherwise you could regret in the future.

Last, but not least, this presentation from Gwen Shapira  How much Kafka?
<https://www.slideshare.net/ConfluentInc/how-much-kafka/ConfluentInc/how-much-kafka>
is a good resource.

Hope that helps.
--
Jonathan



On Sun, Nov 11, 2018 at 3:29 PM Sachit Murarka <connectsachit@gmail.com>
wrote:

> Hi,
>
> Thanks for reply.
> You have shared the command. I am looking for the formula or way to
> calculate the number of partitions for my topic.
>
> Regards,
> Sachit
>
> On Sun, 11 Nov 2018, 20:08 花儿向阳开 <2468946524@qq.com wrote:
>
> > Hi,
> >   Maybe you can use the command like:
> >     kafka-topic.sh --create --topic <topic_name> --partitions
> > <partition_number>  --replication-factor <replica_number> --zookeeper
> > <zookeeperIP:Port>
> >   I hope it helps!
> >
> >
> > Regards!
> > Cathy
> > ------------------ 原始邮件 ------------------
> > 发件人: "Sachit Murarka"<connectsachit@gmail.com>;
> > 发送时间: 2018年11月11日(星期天) 晚上10:48
> > 收件人: "users"<users@kafka.apache.org>;
> >
> > 主题: Deciding number of partitions
> >
> >
> >
> > Hello All,
> >
> > I am new to kafka.  Could anyone please tell how to decided number of
> > partitions for our topic?
> >
> >
> > Kind Regards,
> > Sachit Murarka
>


-- 
Santilli Jonathan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message