kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Santilli <jonathansanti...@gmail.com>
Subject DisconnectException stop Kafka Stream app consuming from topic
Date Fri, 07 Dec 2018 12:33:45 GMT
Hello, hope you all are great today!
am using a Kafka Stream application:

...

*final* StreamsBuilder streamsBuilder = *new* StreamsBuilder();

        *final* KStream<Windowed<MyObject>, MyObject> myObjects =
streamsBuilder

                .stream(inputTopicNames, Consumed.*with*(
myObjectsWindowSerde, myObjectsAvroSerde)

                .withTimestampExtractor(*new* MyObjectsTimeExtractor()));



myObjects.foreach((windowedMyObjectKey, myObjectValue) -> ...);

...

As you can see the stream is just reading and then executing a forEach to
send the myObjectValue to an external system.

The problem came when the app starts logging the following:

*INFO  [kafka-coordinator-heartbeat-thread | my-app-name]
clients.FetchSessionHandler (FetchSessionHandler.java:438) - [Consumer
clientId=my-app-name-c94fe85a-40fa-4ce4-bb22-27dbac7ced6e-StreamThread-4-consumer,
groupId=my-app-name] Error sending fetch request (sessionId=1232856819,
epoch=2) to node 3: org.apache.kafka.common.errors.DisconnectException.*

The log above is shown repeatedly and the App stops reading/processing the
events out of the topic. I have left it in that state for about 30 min to
verify if it recovers by itself but nothing happened.

Is this behavior expected? currently, am solving the situation restarting
the app.

Cheers!
-- 
Santilli Jonathan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message