storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias J. Sax" <mj...@apache.org>
Subject Re: move topologies between servers
Date Thu, 21 Apr 2016 10:38:25 GMT
That is possible, as long as the default scheduler is allowed to deploy
topologies to **all** servers (ie, your special servers are available to
default scheduler, too).

(At least I think no, maybe it is even possible to exclude your special
servers -- see comment below.)

For this, you can instantiate the default scheduler within your custom
one (or let you custom inherit from default).

Each time, you get a scheduling request, you just decide if you want to
forward the request to the default scheduler, or take care of it in you
custom implementation.
(If you are able to modify the cluster meta data about about available
supervisors before you do the forward call to default scheduler, you
might be able to hide your special servers from the default scheduler, too.)


-Matthias


On 04/21/2016 12:08 PM, Susana González wrote:
> Hi,
> 
> As Matthias says, you need to implement your own scheduler and use some
> metadata in the storm.yaml file. This link is a good starting point:
> https://dcvan24.wordpress.com/2015/04/07/metadata-aware-custom-scheduler-in-storm/
> 
> What I haven't been able to do yet it is to mix a customized scheduler
> with the default scheduler. I mean, to configure that some supervisor is
> in charge of some bolts (use your custom scheduler) but the rest of
> supervisors use the default Storm scheduler to be assigned automatically.
> 
> Do someone know how to do this?  Thanks!
> 
> Best,    
>      Susana
> 
> 
> 
> On Thu, Apr 21, 2016 at 11:58 AM, Matthias J. Sax <mjsax@apache.org
> <mailto:mjsax@apache.org>> wrote:
> 
>     For this, you need to provide a custom scheduler. Just search the
>     Internet for example how to do this.
> 
>     Keep in mind, that a custom scheduler will not easily allow you to
>     **move** topologies after they are deployed... But you can control to
>     which servers you want to deploy a topology.
> 
> 
>     -Matthias
> 
>     On 04/21/2016 11:13 AM, Andrey Dudin wrote:
>     > Hi all.
>     >
>     > Do someone have working way to move topologies between servers or up
>     > topology on specific server? Is it possible?
>     >
>     >
>     > --
>     > С уважением Дудин Андрей
>     >
> 
> 


Mime
View raw message