kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhit Kalsotra <abhit...@gmail.com>
Subject Error for partition [__consumer_offsets,15] to broker
Date Wed, 06 Dec 2017 07:54:01 GMT
Hello *

I am running Kafka(*0.10.2.0*) on windows from the past one year ...

But off late there has been unique Broker issues that I have observed 4-5
times in
last 4 months.

Kafka setup cofig...


*3 ZK Instances running on 3 different Windows Servers, 7 Kafka Broker
nodes running on single windows machine with different disk for logs
directory.... *

*My Kafka has 2 Topics with partition size 50 each , and replication factor
of 3.*

*My partition logic selection*: Each message has a unique ID and logic of
selecting partition is ( unique ID % 50), and then calling Kafka producer
API to route a specific message to a particular topic partition .

But of-late there has been a unique case that's cropping out in Kafka
broker nodes,
[2017-12-02 02:47:40,024] ERROR [ReplicaFetcherThread-0-4], Error for
partition [__consumer_offsets,15] to broker
4:org.apache.kafka.common.errors.NotLeaderForPartitionException: This
server is not the leader for that topic-partition.
(kafka.server.ReplicaFetcherThread)

The entire server.log is filled with these logs, and its very huge too ,
please help me in understanding under what circumstances these can occur,
and what measures I need to take..

Courtesy
Abhi
!wq

-- 

If you can't succeed, call it version 1.0

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message