kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sameer Kumar <sam.kum.w...@gmail.com>
Subject Strange rebalancing exception in Kafka 1.0.0
Date Tue, 12 Dec 2017 10:10:04 GMT
Hi All,

Facing an strange exception while running Kafka Streams. I am reading from
a topic of 60 partitions. I am using exactly once in Kafka 1.0.0.

Now, this error has started appearing recently. The application runs fine
on 2 nodes, but as soon as a 3rd node is added, it starts throwing
exception. Please find the stacktrace attached.

2017-12-12 15:32:55 ERROR Kafka010Base:47 - Exception caught in thread
c-7-aq32-5648256f-9142-49e2-98c0-da792e6da48e-StreamThread-5
org.apache.kafka.common.KafkaException: Unexpected error from SyncGroup:
The server experienced an unexpected error when processing the request
        at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:566)
        at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:539)
        at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:808)
        at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:788)
        at
org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:204)
        at
org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:167)
        at
org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:127)
        at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(ConsumerNetworkClient.java:506)
        at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(ConsumerNetworkClient.java:353)
        at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:268)
        at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:214)
        at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:174)
        at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:364)
        at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:316)
        at
org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:295)
        at
org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1138)
        at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1103)
        at
org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:851)
        at
org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:808)
        at
org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:774)
        at
org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:744)



-Sameer.

Mime
View raw message