kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sgh6688@163.com" <sgh6...@163.com>
Subject 回复: 回复:Deciding number of partitions
Date Mon, 12 Nov 2018 01:48:30 GMT
well, it's complicated to decide the num of partitons, it's up on your application. I think
8-64 is a better practise for most application, such as 16/32 partitions with 2 or 3 replicas.

generally,
the less the num of partitions you have , the less tps you will get,
the more the num of partitions you have, the more cpu/io/mem/fd...  it will occupies.  And
too many partitons means too many files which means sequence writting will be broken to random
writting and reading.

forgive my poor English~



沈光辉 
中国银联 科技事业部 云闪付团队
电话:20633284 | 13696519872
上海市浦东新区顾唐路1699号 中国银联园区

 
发件人: 花儿向阳开
发送时间: 2018-11-11 22:38
收件人: users
主题: 回复:Deciding number of partitions
Hi,
  Maybe you can use the command like: 
    kafka-topic.sh --create --topic <topic_name> --partitions <partition_number>
 --replication-factor <replica_number> --zookeeper <zookeeperIP:Port>
  I hope it helps!
 
 
Regards!
Cathy 
------------------ 原始邮件 ------------------
发件人: "Sachit Murarka"<connectsachit@gmail.com>;
发送时间: 2018年11月11日(星期天) 晚上10:48
收件人: "users"<users@kafka.apache.org>;
 
主题: Deciding number of partitions
 
 
 
Hello All,
 
I am new to kafka.  Could anyone please tell how to decided number of
partitions for our topic?
 
 
Kind Regards,
Sachit Murarka
Mime
  • Unnamed multipart/related (inline, None, 0 bytes)
View raw message