kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shrikant Patel <SPa...@pdxinc.com>
Subject Kafka partition no migrating to another broker.
Date Thu, 02 Mar 2017 21:20:53 GMT
I have 5 broker kafka cluster. Replication factor = 3, Number of partition = 12, Min Insync
repica (ISR) = 3

First output is when all server are up and running. Second output is when I bring down server
id = 4. Another server from ISR take server 4's place as leader of partition, so that's good.
I was expecting another broker will join ISR in place for server 4. Why doesn't that happen?
Since min ISR is 3, I cannot publish to certain partitions of the topic.

When server 4 comes back up, it starts to work fine.

./bin/kafka-topics.sh --zookeeper localhost:2181 --describe --topic xxx
Topic:xxx   PartitionCount:12       ReplicationFactor:3     Configs:
        Topic: xxx  Partition: 0    Leader: 5       Replicas: 5,2,3 Isr: 3,2,5
        Topic: xxx  Partition: 1    Leader: 1       Replicas: 1,3,4 Isr: 3,4,1
        Topic: xxx  Partition: 2    Leader: 2       Replicas: 2,4,5 Isr: 2,5,4
        Topic: xxx  Partition: 3    Leader: 3       Replicas: 3,5,1 Isr: 5,3,1
        Topic: xxx  Partition: 4    Leader: 4       Replicas: 4,1,2 Isr: 2,4,1
        Topic: xxx  Partition: 5    Leader: 5       Replicas: 5,3,4 Isr: 3,5,4
        Topic: xxx  Partition: 6    Leader: 1       Replicas: 1,4,5 Isr: 5,4,1
        Topic: xxx  Partition: 7    Leader: 2       Replicas: 2,5,1 Isr: 5,2,1
        Topic: xxx  Partition: 8    Leader: 3       Replicas: 3,1,2 Isr: 3,2,1
        Topic: xxx  Partition: 9    Leader: 4       Replicas: 4,2,3 Isr: 3,2,4
        Topic: xxx  Partition: 10   Leader: 5       Replicas: 5,4,1 Isr: 5,4,1
        Topic: xxx  Partition: 11   Leader: 1       Replicas: 1,5,2 Isr: 5,2,1


./bin/kafka-topics.sh --zookeeper localhost:2181 --describe --topic xxx
Topic:xxx   PartitionCount:12       ReplicationFactor:3     Configs:
        Topic: xxx  Partition: 0    Leader: 5       Replicas: 5,2,3 Isr: 3,2,5
        Topic: xxx  Partition: 1    Leader: 1       Replicas: 1,3,4 Isr: 3,1
        Topic: xxx  Partition: 2    Leader: 2       Replicas: 2,4,5 Isr: 2,5
        Topic: xxx  Partition: 3    Leader: 3       Replicas: 3,5,1 Isr: 5,3,1
        Topic: xxx  Partition: 4    Leader: 1       Replicas: 4,1,2 Isr: 2,1
        Topic: xxx  Partition: 5    Leader: 5       Replicas: 5,3,4 Isr: 3,5
        Topic: xxx  Partition: 6    Leader: 1       Replicas: 1,4,5 Isr: 5,1
        Topic: xxx  Partition: 7    Leader: 2       Replicas: 2,5,1 Isr: 5,2,1
        Topic: xxx  Partition: 8    Leader: 3       Replicas: 3,1,2 Isr: 3,2,1
        Topic: xxx  Partition: 9    Leader: 2       Replicas: 4,2,3 Isr: 2,3
        Topic: xxx  Partition: 10   Leader: 5       Replicas: 5,4,1 Isr: 5,1
        Topic: xxx  Partition: 11   Leader: 1       Replicas: 1,5,2 Isr: 5,2,1

./bin/kafka-topics.sh --zookeeper localhost:2181 --describe --topic xxx
Topic:xxx   PartitionCount:12       ReplicationFactor:3     Configs:
        Topic: xxx  Partition: 0    Leader: 5       Replicas: 5,2,3 Isr: 3,2,5
        Topic: xxx  Partition: 1    Leader: 1       Replicas: 1,3,4 Isr: 3,1,4
        Topic: xxx  Partition: 2    Leader: 2       Replicas: 2,4,5 Isr: 2,5,4
        Topic: xxx  Partition: 3    Leader: 3       Replicas: 3,5,1 Isr: 5,3,1
        Topic: xxx  Partition: 4    Leader: 4       Replicas: 4,1,2 Isr: 2,1,4
        Topic: xxx  Partition: 5    Leader: 5       Replicas: 5,3,4 Isr: 3,5,4
        Topic: xxx  Partition: 6    Leader: 1       Replicas: 1,4,5 Isr: 5,1,4
        Topic: xxx  Partition: 7    Leader: 2       Replicas: 2,5,1 Isr: 5,2,1
        Topic: xxx  Partition: 8    Leader: 3       Replicas: 3,1,2 Isr: 3,2,1
        Topic: xxx  Partition: 9    Leader: 4       Replicas: 4,2,3 Isr: 2,3,4
        Topic: xxx  Partition: 10   Leader: 5       Replicas: 5,4,1 Isr: 5,1,4
        Topic: xxx  Partition: 11   Leader: 1       Replicas: 1,5,2 Isr: 5,2,1



Thanks,
Shri

This e-mail and its contents (to include attachments) are the property of National Health
Systems, Inc., its subsidiaries and affiliates, including but not limited to Rx.com Community
Healthcare Network, Inc. and its subsidiaries, and may contain confidential and proprietary
or privileged information. If you are not the intended recipient of this e-mail, you are hereby
notified that any unauthorized disclosure, copying, or distribution of this e-mail or of its
attachments, or the taking of any unauthorized action based on information contained herein
is strictly prohibited. Unauthorized use of information contained herein may subject you to
civil and criminal prosecution and penalties. If you are not the intended recipient, please
immediately notify the sender by telephone at 800-433-5719 or return e-mail and permanently
delete the original e-mail.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message