storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stig Rohde Døssing <>
Subject Re: KafkaSpout reconsume all kafka messages after kafka rolling restart
Date Mon, 21 Aug 2017 14:48:34 GMT
Hi Elyahou,

Could you post your spout configuration, Kafka version and
storm-kafka-client version? The logs imply that your spouts are not polling
often enough.

2017-08-21 9:44 GMT+02:00 Elyahou Ittah <>:

> I noticed that storm kafka spout reconsume all kafka message after a
> rolling restart of kafka cluster.
> This issue occured only with kafkaSpout consumer and not for my other
> consumers (ruby based  using the kafka consumer API like kafkaSpout)
> Attached logs of the spout.
> Do you know what can cause this kind of behavior ?

View raw message