storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stig Rohde Døssing <s...@apache.org>
Subject Re: KafkaSpout reconsume all kafka messages after kafka rolling restart
Date Mon, 21 Aug 2017 14:48:34 GMT
Hi Elyahou,

Could you post your spout configuration, Kafka version and
storm-kafka-client version? The logs imply that your spouts are not polling
often enough.

2017-08-21 9:44 GMT+02:00 Elyahou Ittah <elyahou.i@fiverr.com>:

> I noticed that storm kafka spout reconsume all kafka message after a
> rolling restart of kafka cluster.
>
> This issue occured only with kafkaSpout consumer and not for my other
> consumers (ruby based  using the kafka consumer API like kafkaSpout)
>
> Attached logs of the spout.
>
> Do you know what can cause this kind of behavior ?
>

Mime
View raw message