storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsha <st...@harsha.io>
Subject Re: Storm Kafka Processing
Date Mon, 02 Feb 2015 14:44:10 GMT

Vineet, Which kafka spout are you using? -Harsha


On Mon, Feb 2, 2015, at 05:25 AM, Vineet Mishra wrote:
> Hi,
>
> I am running Kafka Storm Engine to process real time data generated on
> a 3 node distributed cluster.
>
> Currently I have set 10 Executors for Storm Spout, which I don't think
> is running in parallel. Moreover earlier I was running the Kafka
> Topology with Replication Factor and Partitions as 1(which seems to
> have run comparatively faster), now I gave the Replication Factor as 3
> and Partitions as 10 and I could see the performance degradation.
>
> Is there any way I can max utilize the available resource and get the
> max throughput of event processing.
>
> Looking for the expert suggestions at URGENT.
>
> Thanks!


Mime
View raw message