storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rohit Kelkar <rohitkel...@gmail.com>
Subject Re: messages traveling slowly through storm
Date Thu, 08 Oct 2015 03:56:29 GMT
Does it matter that I am ack-ing the tick tuples in the execute method of
the bolt? Will that give rise to double ack-ing of the tuples and create
some inconsistent state?

Thanks.

On Wed, Oct 7, 2015 at 10:53 PM, Rohit Kelkar <rohitkelkar@gmail.com> wrote:

> Thanks for responding.
> Kafka Spout parallelism = 1, number of partitions of kafka topic=1,
> Tried various values for topology.max.spout.pending=64,100, 1024
>
> Thanks.
>
> On Wed, Oct 7, 2015 at 10:06 PM, Harsha <storm@harsha.io> wrote:
>
>> whats your Kafka Spout parallelism and how many partitions you've in your
>> kafka topic. Also did you try to tune topology.max.spout.pending
>> -Harsha
>>
>>
>> On Wed, Oct 7, 2015, at 10:54 AM, Rohit Kelkar wrote:
>>
>> I have a kafka spout and single bolt topology running on a cluster in
>> debug mode. I see that the message is sent from kafka spout at 17:02:48 and
>> received at the bolt at 17:02:56
>> Here are the relevant logs - http://pastebin.com/WBxmPjLk
>> I checked the network traffic. No signs of saturation.
>> Am I filling up the internal buffers of storm? Is there any way to
>> identify this?
>>
>> Thanks.
>>
>>
>>
>>
>
>

Mime
View raw message