storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Owen Rees-Hayward <>
Subject Backpressure limitations
Date Thu, 19 Jan 2017 11:11:51 GMT

I noticed that the current back pressure implementation stops upstream
spouts even if the triggering bolt has 'free' instances (due to
parallelism) and is on a stream that has shuffle grouping (rather than by

Conceptually, it seems that this is unnecessary and that, with shuffle
grouping, Storm could still distribute tuples over the bolts that were not
exhibiting back pressure.

I was wondering if anyone was aware of any work to improve this for either
1.x or the 2.0 work?

Thanks, Owen

*Owen Rees-Hayward*
*Data Engineer*
+44 (0) 7912 876046

*follow me on twitter?* <>

View raw message