kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <Vishal_Ja...@Dell.com>
Subject Help: Kafka LeaderNotAvailableException
Date Thu, 22 Jan 2015 09:33:56 GMT
Hi,
Let me overview on the issue that I am facing on producing message in Kafka:
I have horthonworks HDP-2.1 installed, along that we have Kafka on other node.

* On kafka node:
Start Zookeepeer
Start Kafka Broker service
Send message/producer
Consume message - Works (Note: here we start Zookeeper locally on kafka01 node)

* Issue side:
>Now in HDP-2.1 we have Zookeeper inbuild & we have Zookeeper service running on master
node
>I go to Kafka server & Started Kafka Broker
(In config\server.properties file I have added zookeeper.connect with maasternode:2181)
Then I start producer & Send message... after that we got error like kafka.common.LeaderNotAvailableException

[2015-01-17 05:54:09,465] WARN Error while fetching metadata [{TopicMetadata for topic fred
->
No partition metadata for topic fred due to kafka.common.LeaderNotAvailableException}] for
topic [fred]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-17 05:54:09,659] WARN Error while fetching metadata [{TopicMetadata for topic fred
->
No partition metadata for topic fred due to kafka.common.LeaderNotAvailableException}] for
topic [fred]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-17 05:54:09,659] ERROR Failed to collate messages by topic, partition due to: Failed
to fetch topic metadata for topic: fred (kafka.producer.async.DefaultEventHandler)
[2015-01-17 05:54:09,802] WARN Error while fetching metadata [{TopicMetadata for topic fred
->
No partition metadata for topic fred due to kafka.common.LeaderNotAvailableException}] for
topic [fred]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-17 05:54:09,820] ERROR Failed to send requests for topics fred with correlation ids
in [0,8] (kafka.producer.async.DefaultEventHandler)
[2015-01-17 05:54:09,822] ERROR Error in handling batch of 1 events (kafka.producer.async.ProducerSendThread)
kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries.
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:90)
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104)
at kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:87)

Can someone suggest what is going wrong.!!!!
Thanks.





-Vishal


Regards,
Vishal
Software Dev Staff Engineer
Dell | Bangalore
Ext : 79268


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message