storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Owen Rees-Hayward <o...@agilesoft.co.uk>
Subject Backpressure limitations
Date Thu, 19 Jan 2017 11:11:51 GMT
Hi,

I noticed that the current back pressure implementation stops upstream
spouts even if the triggering bolt has 'free' instances (due to
parallelism) and is on a stream that has shuffle grouping (rather than by
field).

Conceptually, it seems that this is unnecessary and that, with shuffle
grouping, Storm could still distribute tuples over the bolts that were not
exhibiting back pressure.

I was wondering if anyone was aware of any work to improve this for either
1.x or the 2.0 work?

Thanks, Owen

-- 
*Owen Rees-Hayward*
*Data Engineer*
owenrh.me.uk
owen@agilesoft.co.uk
+44 (0) 7912 876046

*follow me on twitter?* <http://twitter.com/owen4d>

Mime
View raw message