kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wollert, Fabian" <fabian.woll...@zalando.de>
Subject Kafka Zookeeper Issues
Date Mon, 03 Aug 2015 10:20:51 GMT
hi everyone,

we are trying to deploy Kafka 0.8.2.1 and Zookeeper on AWS using
Cloudformation, ASG's and other Services. For Zookeeper we are using
Netflix' Exhibitor (V 1.5.5) to ensure failover stability.

What we are observing right now is that after some days our Brokers are not
registered anymore in the "/brokers/ids" path in Zookeeper. I was trying to
see when they get deleted to check the logs, but the ZK Transaction logs
only shows the create stmt, no deletes or something (though deletes are
written down there). Can someone explain me how the mechanism works with
registering and deregistering in Zookeeper or point me to a doc or even
source code, where this happens? Or some one has even some idea what
happens there.

Any experience on what to take care of deploying kafka on AWS (or generally
a cloud env) would be also helpful.

Cheers

-- 
*Fabian Wollert*
Business Intelligence

*POSTAL ADDRESS*
Zalando SE
11501 Berlin

*OFFICE*
Zalando SE
Mollstra├če 1
10178 Berlin
Germany

Phone: +49 30 20968 1819
Fax:   +49 30 27594 693
E-Mail: fabian.wollert@zalando.de
Web: www.zalando.de
Jobs: jobs.zalando.de

Zalando SE, Tamara-Danz-Stra├če 1, 10243 Berlin
Company registration: Amtsgericht Charlottenburg, HRB 158855 B
Tax ID: 29/560/00596 * VAT registration number: DE 260543043
Management Board: Robert Gentz, David Schneider, Rubin Ritter
Chairperson of the Supervisory Board: Cristina Stenbeck
Registered office: Berlinn

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message