kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shailesh Hemdev <shailesh.hem...@foresee.com>
Subject Kafka Errors and Hung Brokers
Date Wed, 14 Dec 2016 02:53:02 GMT
We are using a 3 node Kafka cluster and are encountering some weird issues.

1) On Each node, when we tail the server.log file under /var/log/kafka we
see continuous errors like these

pic-partition. (kafka.server.ReplicaFetcherThread)
[2016-12-14 02:39:30,747] ERROR [ReplicaFetcherThread-0-4410000], Error for
partition [dev-core-platform-logging,15] to broker 4410000:org.apache.kafka.
common.errors.NotLeaderForPartitionException: This server is not the leader
for that topic-partition. (kafka.server.ReplicaFetcherThread)

The broker is up and is showing under zookeeper. So it is not clear why
these errors occur

2) Occasionally we will find a Kafka broker that goes down. We have
adjusted the Ulimit to increase open files as well as added 6g to the heap.
When the broker goes down, the process is itself up but is de registered
from Zookeeper

Thanks,

*Shailesh *

-- 

*Shailesh Hemdev*
Manager, Software Engineering
shailesh.hemdev@foresee.com
p (734) 352-6247
<https://t.xink.io/Tracking/Index/6qgAAGJcAACj1gkA0>

-- 


This email communication (including any attachments) contains information 
from Answers Corporation or its affiliates that is confidential and may be 
privileged. The information contained herein is intended only for the use 
of the addressee(s) named above. If you are not the intended recipient (or 
the agent responsible to deliver it to the intended recipient), you are 
hereby notified that any dissemination, distribution, use, or copying of 
this communication is strictly prohibited. If you have received this email 
in error, please immediately reply to sender, delete the message and 
destroy all copies of it. If you have questions, please email 
legal@answers.com. 

If you wish to unsubscribe to commercial emails from Answers and its 
affiliates, please go to the Answers Subscription Center 
http://campaigns.answers.com/subscriptions to opt out.  Thank you.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message