kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From SenthilKumar K <senthilec...@gmail.com>
Subject Re: Moving partition(s) to different broker
Date Tue, 12 Nov 2019 07:56:05 GMT
Thanks, Peter for the quick response.

You may need to enable unclean leader election, as well. - We already set
unclean leader election to true. Unfortunately both brokers went down
within 10 minutes of time. Another option is to increase the replication
factor to 3 from 2. Right now the goal is to have no offline partitions in
a cluster.

Is your goal just to have no offline partitions or to recover the data
contained in the affected partition? - Our goal is to have no offline
partitions. We are fine with losing the data of affected partition.

--Senthil

On Tue, Nov 12, 2019 at 1:18 PM Peter Bukowinski <pmbuko@gmail.com> wrote:

> If the only replicas for that topic partition exist on brokers 15 and 24
> and they are both down, then you cannot recover the partition until either
> of them is replaced or repaired and rejoins the cluster. You may need to
> enable unclean leader election, as well.
>
> As you’ve discovered, adding replicas to an offline partition partition
> doesn’t work. A topic/partition needs to be in a healthy state for that to
> work.
>
> Is your goal just to have no offline partitions or to recover the data
> contained in the affected partition? Producers and consumers should still
> be able to access the topic in its current state.
>
> --
> Peter
>
> > On Nov 11, 2019, at 11:34 PM, SenthilKumar K <senthilec566@gmail.com>
> wrote:
> >
> > Hi Experts, We have seen a problem with partition leader i.e it's set
> to -1.
> >
> > describe o/p:
> > Topic: 1453 Partition: 47 Leader: -1 Replicas: 24,15 Isr: 24
> >
> > Kafka Version: 2.2.0
> > Replication:  2
> > Partitions: 48
> >
> > Brokers 24 ,15 both are down due to disk errors and we lost the partition
> > 47. I tried increasing the replica ( 2 to 3 ) of the partition alone
> using
> > the Kafka partition reassignment tool but that didn't help.
> >
> > {
> >
> > "version": 1,
> >
> > "partitions": [{
> >
> > "topic": "1453",
> >
> > "partition": 47,
> >
> > "replicas": [22, 11, 5],
> >
> > "log_dirs": ["any", "any", "any"]
> >
> > }]
> >
> > }
> >
> >
> > Reassignment of partition 1453-47 is still in progress - Its stuck more
> > than 3 hours.
> >
> >
> > How to recover the partition 47? Pls advise. Thanks!
> >
> > --Senthil
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message