kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Questions about the leader election
Date Fri, 23 Aug 2013 14:47:05 GMT
ZK paths for 0.8 are documented in
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+data+structures+in+Zookeeper

If a controller fails, any live broker can become the leader. This is
coordinated through an ephemeral path in ZK.

Thanks,

Jun


On Fri, Aug 23, 2013 at 3:37 AM, James Wu <jameswu629@gmail.com> wrote:

> Thank you Neha, it's very helpful information!
>
> I also read this article
>
> http://engineering.linkedin.com/kafka/intra-cluster-replication-apache-kafka
> For the section "Handling Failures", I am wondering some questions:
>
> 1. "The leader and the ISR for each partition are also stored in Zookeeper
> and are used during the failover of the controller." What path does it be
> stored ? Is there any way to see the information on zookeeper ?
>
> 2. If the controller fail, how does the new controller be elected ? Does it
> be elected by Zookeeper ? How does Zookeeper decide which node should be
> the controller ?
>
> Many thanks!
>
>
>
>
> On Fri, Aug 23, 2013 at 11:59 AM, Neha Narkhede <neha.narkhede@gmail.com
> >wrote:
>
> > The replication state machine and leader election mechanism is described
> > here - http://kafka.apache.org/documentation.html#replication
> >
> > Let us know how the docs can be improved.
> >
> > Thanks,
> > Neha
> >
> >
> > On Thu, Aug 22, 2013 at 8:51 PM, James Wu <jameswu629@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > I am wondering what is the mechanism that Kafka elects the leader of
> > > partitions ?
> > >
> > > Does it handle by the controller process or ?
> > > If the leader crashed, who will decide the new leader ? and the process
> > is
> > > running on Zookeeper or Kafka?
> > >
> > >
> > > Thanks.
> > >
> > > --
> > > --
> > > Friendly regards,
> > >
> > > *James Wu <http://www.facebook.com/jameswu629>*
> > >
> >
>
>
>
> --
>
> Friendly regards,
>
> *James Wu <https://plus.google.com/u/0/100829801349304669533>
> *
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message