storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Elyahou Ittah <elyaho...@fiverr.com>
Subject Re: KafkaSpout reconsume all kafka messages after kafka rolling restart
Date Mon, 21 Aug 2017 15:17:09 GMT
The config is the default one, I just set the bootstrap server.

Kafka version is 0.11

Storm-kafka-client is 1.1.0

On Mon, Aug 21, 2017 at 5:48 PM, Stig Rohde Døssing <srdo@apache.org> wrote:

> Hi Elyahou,
>
> Could you post your spout configuration, Kafka version and
> storm-kafka-client version? The logs imply that your spouts are not polling
> often enough.
>
> 2017-08-21 9:44 GMT+02:00 Elyahou Ittah <elyahou.i@fiverr.com>:
>
>> I noticed that storm kafka spout reconsume all kafka message after a
>> rolling restart of kafka cluster.
>>
>> This issue occured only with kafkaSpout consumer and not for my other
>> consumers (ruby based  using the kafka consumer API like kafkaSpout)
>>
>> Attached logs of the spout.
>>
>> Do you know what can cause this kind of behavior ?
>>
>
>

Mime
View raw message