kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "蔡高年" <838199...@qq.com>
Subject 0.10.1.0 version kafka replica syn slow
Date Thu, 11 May 2017 03:45:19 GMT
hello
recently ,our prod environment have a proplem,the kafka leader Shrinking and Expanding IsR
frequently,result in the  consumer can not consume the message.do you have any advice?


thank you.


here is the log related.





[serviceop@SZC-L0046001 kafka]$ ./bin/kafka-topics.sh --describe --zookeeper 30.16.36.181:2181,30.16.36.182:2181,30.16.36.183:2181/ubasKafka
--topic kafkaUbasTopicProd

 

Topic:kafkaUbasTopicProd        PartitionCount:8        ReplicationFactor:3     Configs:

        Topic: kafkaUbasTopicProd       Partition: 0    Leader: 1       Replicas: 1,7,0 Isr:
1,7,0

        Topic: kafkaUbasTopicProd       Partition: 1    Leader: 2       Replicas: 2,0,1 Isr:
1,2,0

        Topic: kafkaUbasTopicProd       Partition: 2    Leader: 3       Replicas: 3,1,2 Isr:
1,2,3

        Topic: kafkaUbasTopicProd       Partition: 3    Leader: 4       Replicas: 4,2,3 Isr:
2,3,4

        Topic: kafkaUbasTopicProd       Partition: 4    Leader: 5       Replicas: 5,3,4 Isr:
3,4,5

        Topic: kafkaUbasTopicProd       Partition: 5    Leader: 6       Replicas: 6,4,5 Isr:
4,5,6

        Topic: kafkaUbasTopicProd       Partition: 6    Leader: 7       Replicas: 7,5,6 Isr:
5,6,7

        Topic: kafkaUbasTopicProd       Partition: 7    Leader: 0       Replicas: 0,6,7 Isr:
0










[2017-05-09 18:28:34,533] INFO Partition [kafkaUbasTopicProd,7] on broker 0: Expanding ISR
for partition [kafkaUbasTopicProd,7] from 0 to 0,6 (kafka.cluster.Partition)

[2017-05-09 18:28:53,901] INFO Partition [kafkaUbasTopicProd,7] on broker 0: Shrinking ISR
for partition [kafkaUbasTopicProd,7] from 0,6 to 0 (kafka.cluster.Partition)

[2017-05-09 18:33:03,901] INFO Partition [__consumer_offsets,2] on broker 0: Shrinking ISR
for partition [__consumer_offsets,2] from 0,5,6 to 0,5 (kafka.cluster.Partition)





[2017-05-09 18:33:03,903] INFO Partition [__consumer_offsets,10] on broker 0: Shrinking ISR
for partition [__consumer_offsets,10] from 0,6,7 to 0,7 (kafka.cluster.Partition)
Mime
  • Unnamed multipart/alternative (inline, 8-Bit, 0 bytes)
View raw message