storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vineet Mishra <clearmido...@gmail.com>
Subject Storm Kafka Processing
Date Mon, 02 Feb 2015 13:25:43 GMT
Hi,

I am running Kafka Storm Engine to process real time data generated on a 3
node distributed cluster.

Currently I have set 10 Executors for Storm Spout, which I don't think is
running in parallel.
Moreover earlier I was running the Kafka Topology with Replication Factor
and Partitions as 1(which seems to have run comparatively faster), now I
gave the Replication Factor as 3 and Partitions as 10 and I could see the
performance degradation.

Is there any way I can max utilize the available resource and get the max
throughput of event processing.

Looking for the expert suggestions at URGENT.

Thanks!

Mime
View raw message