Hello,

I am trying to control my cluster's parallelism and I want to achieve the following: 1 worker per component, and 1 executioner per worker and 1 task per executioner. In order to achieve the former, I submit my components to the topology as follows:

Config conf = new Config();

TopologyBuilder builder = new TopologyBuilder();

builder.setSpout("spout_1",
new GreenSpout(), 1)
.setNumTasks(1);

builder.setBolt("bolt_1",
                new GreenBolt(), 1)
                .setNumTasks(1)
                .directGrouping("spout_1");
builder.setBolt("bolt_2",
                new RedBolt(), 1)
                .setNumTasks(1)
                .directGrouping("bolt_1");
builder.setBolt("bolt_3",
                new YellowBolt(), 1)
                .setNumTasks(1)
                .directGrouping("bolt_2");

conf.setDebug(true);
conf.setNumWorkers(4);
StormSubmitter.submitTopology("experimental-top", conf, builder.createTopology());

The above not only sets the parallelism hint (executioner threads per worker) to 1, but also the number of workers per component to 1. However, when I submit my topology, and I perform a storm list, I can see that I have 4 workers and 8 tasks running. Is this normal? My goal is to have each component executed by 1 thread on each machine. Am I missing something?

Thanks,

Nick

Nikolaos Romanos Katsipoulakis,

University of Pittsburgh, PhD candidate