kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chinmay Soman <chinmay.cere...@gmail.com>
Subject Re: Question regarding Kafka EventThread
Date Wed, 05 Aug 2015 22:47:21 GMT
After digging in the 0.8.2 code, it seems like the callback is not getting
invoked since 'handleDisconnections' is not adding a disconnected
ClientResponse to the list of responses. I do see a 'Node 0 disconnected'
message. However, I don't see a 'Cancelled request due to node being
disconnected' message.

Is this expected ? Is any of this because I'm only using 1 Kafka broker
node ? Will the producer get stuck if the Kafka cluster is not reachable
for whatever reason ?

On Wed, Aug 5, 2015 at 12:12 PM, Chinmay Soman <chinmay.cerebro@gmail.com>

> Hey guys,
> We're using Kafka version and using the Java producer
> (KafkaProducer) to write to a single Kafka broker with acks=1. There's a
> callback defined on every produce request which takes corrective action if
> the write fails.
> What we see is that, if the broker is down for an extended period of time,
> any write to the producer gets stuck, with this message:
> [2015-08-05 12:02:04,743] WARN Error in I/O with /........
> (org.apache.kafka.common.network.Selector:276)
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> at java.lang.Thread.run(Thread.java:745)
> This goes on repeatedly and the callback is never invoked. Is there a way
> to get the Kafka EventThread to give up after a while ?
> --
> Thanks and regards
> Chinmay Soman

Thanks and regards

Chinmay Soman

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message