kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hu Xi <huxi...@hotmail.com>
Subject 答复: 0.10.1.0 version kafka replica syn slow
Date Thu, 11 May 2017 10:34:39 GMT
If you confirm it's the reason, then try to increase `num.replica.fetchers` to speed up the
replication.

________________________________
发件人: 蔡高年 <838199230@qq.com>
发送时间: 2017年5月11日 11:45
收件人: users
主题: 0.10.1.0 version kafka replica syn slow

hello
recently ,our prod environment have a proplem,the kafka leader Shrinking and Expanding IsR
frequently,result in the  consumer can not consume the message.do you have any advice?


thank you.


here is the log related.





[serviceop@SZC-L0046001 kafka]$ ./bin/kafka-topics.sh --describe --zookeeper 30.16.36.181:2181,30.16.36.182:2181,30.16.36.183:2181/ubasKafka
--topic kafkaUbasTopicProd



Topic:kafkaUbasTopicProd        PartitionCount:8        ReplicationFactor:3     Configs:

        Topic: kafkaUbasTopicProd       Partition: 0    Leader: 1       Replicas: 1,7,0 Isr:
1,7,0

        Topic: kafkaUbasTopicProd       Partition: 1    Leader: 2       Replicas: 2,0,1 Isr:
1,2,0

        Topic: kafkaUbasTopicProd       Partition: 2    Leader: 3       Replicas: 3,1,2 Isr:
1,2,3

        Topic: kafkaUbasTopicProd       Partition: 3    Leader: 4       Replicas: 4,2,3 Isr:
2,3,4

        Topic: kafkaUbasTopicProd       Partition: 4    Leader: 5       Replicas: 5,3,4 Isr:
3,4,5

        Topic: kafkaUbasTopicProd       Partition: 5    Leader: 6       Replicas: 6,4,5 Isr:
4,5,6

        Topic: kafkaUbasTopicProd       Partition: 6    Leader: 7       Replicas: 7,5,6 Isr:
5,6,7

        Topic: kafkaUbasTopicProd       Partition: 7    Leader: 0       Replicas: 0,6,7 Isr:
0










[2017-05-09 18:28:34,533] INFO Partition [kafkaUbasTopicProd,7] on broker 0: Expanding ISR
for partition [kafkaUbasTopicProd,7] from 0 to 0,6 (kafka.cluster.Partition)

[2017-05-09 18:28:53,901] INFO Partition [kafkaUbasTopicProd,7] on broker 0: Shrinking ISR
for partition [kafkaUbasTopicProd,7] from 0,6 to 0 (kafka.cluster.Partition)

[2017-05-09 18:33:03,901] INFO Partition [__consumer_offsets,2] on broker 0: Shrinking ISR
for partition [__consumer_offsets,2] from 0,5,6 to 0,5 (kafka.cluster.Partition)





[2017-05-09 18:33:03,903] INFO Partition [__consumer_offsets,10] on broker 0: Shrinking ISR
for partition [__consumer_offsets,10] from 0,6,7 to 0,7 (kafka.cluster.Partition)
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message