storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jungtaek Lim <>
Subject Re: Rebalance in apache Storm
Date Thu, 02 Feb 2017 08:43:49 GMT
Hi anshu,

It's up to the Spout implementation. In normal, if spout guarantees
at-least once via handling ack, messages will be replayed after rebalancing.

Regarding rebalance operation, I guess relevant issue (and PR) is open:
STORM-2286 <> which you
might want to take a look. I haven't reviewed the PR but would like to get
it later.

Jungtaek Lim (HeartSaVioR)

2017년 2월 2일 (목) 오후 2:27, anshu shukla <>님이 작성:

> Hello all,
> I am research student and working on the dynamic scheduler for Storm.
> *I just want to know the impact of Re-balance operation on messages loss.
> i.e. What happens to the messages that are not processed within the wait
> time for rebalance ?*
> I found that on doing Re-balance operation only workers whose thread
> mapping is changed is being re-started. So I have 2 choices now either To
> reset mapping to all workers or design my logic in such way that minimal
> old mapping is impacted. I was trying to figure out that is there any
> benefit of doing one over the other.
> --
> Thanks & Regards,
> Anshu Shukla

View raw message