storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nathan Leung <ncle...@gmail.com>
Subject Re: Multiple output streams: all go through the same connection?
Date Wed, 06 Jan 2016 20:36:51 GMT
Look at
http://www.michael-noll.com/blog/2013/06/21/understanding-storm-internal-message-buffers/.
Pretty sure it's using one port for all of the communications.  Also ZMQ is
not a queue, especially not a brokered one, and storm uses netty by default
in the latest versions.

On Wed, Jan 6, 2016 at 3:23 PM, Annabel Melongo <melongo_annabel@yahoo.com>
wrote:

> John,
>
> It depends on how you defined your topology. If you created a topology
> made of one spout, two streams and a bolt, then the data received from the
> spout is going to go down to the bolt via those two streams. Spouts and
> bolts are connected through streams.
>
> Thanks
>
>
> On Wednesday, January 6, 2016 3:01 PM, Ankur Garg <ankurgarg9@gmail.com>
> wrote:
>
>
> Hi John ,
>
> I am not aware of the storm internal working so I am not sure about this .
> But since no one has answered this so far , I will try my hand .
>
> I believe Spouts and Bolts communicate through an intermediate queue (ZMQ)
> . Assuming this it should always be a single connection to ZMQ .
>
> But Like I said , this is what I think should be the case . Waiting for
> any of the member to validate/invalidate  this.
>
> Thanks
> Ankur
>
> On Wed, Jan 6, 2016 at 7:47 AM, John Yost <hokiegeek2@gmail.com> wrote:
>
> Hi Everyone,
>
> Had a co-worker ask me today if, I define two output streams for a spout
> or bolt, do they both go out over the same connection to a downstream bolt,
> or are there separate connections for each output stream.
>
> Anyone know?
>
> Thanks
>
> --John
>
>
>
>
>

Mime
View raw message