storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Srinath C <>
Subject Re: storm scheduler behavior
Date Mon, 12 May 2014 01:06:21 GMT
Hi Weide,

I haven't found any material on this matter. But as far as I could figure
out, the strategy seems to try to evenly divide the total number of
executors among the worker processes. If a particular spout/bolt has
multiple executors, it tries to span them across all the worker processes.

However, I could not find out if the topology layout or groupings between
the components have any role to play in the distribution.


On Sun, May 11, 2014 at 10:12 PM, Weide Zhang <> wrote:

> Hi
> Is there any good documentation how storm does resource allocation and how
> does it maps a topology to different work process and how was it decided to
> group components in one worker process or across worker process ?
> i'm trying to understand what algorithm it uses to partition the topology
> and in the meanwhile considering the resource constraint to achieve best
> performance if there is something available here ?
> Thanks,
> Weide

View raw message