storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rohit Kelkar <rohitkel...@gmail.com>
Subject Re: messages traveling slowly through storm
Date Thu, 08 Oct 2015 03:53:06 GMT
Thanks for responding.
Kafka Spout parallelism = 1, number of partitions of kafka topic=1,
Tried various values for topology.max.spout.pending=64,100, 1024

Thanks.

On Wed, Oct 7, 2015 at 10:06 PM, Harsha <storm@harsha.io> wrote:

> whats your Kafka Spout parallelism and how many partitions you've in your
> kafka topic. Also did you try to tune topology.max.spout.pending
> -Harsha
>
>
> On Wed, Oct 7, 2015, at 10:54 AM, Rohit Kelkar wrote:
>
> I have a kafka spout and single bolt topology running on a cluster in
> debug mode. I see that the message is sent from kafka spout at 17:02:48 and
> received at the bolt at 17:02:56
> Here are the relevant logs - http://pastebin.com/WBxmPjLk
> I checked the network traffic. No signs of saturation.
> Am I filling up the internal buffers of storm? Is there any way to
> identify this?
>
> Thanks.
>
>
>
>

Mime
View raw message