storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Weathers <eweath...@groupon.com>
Subject Re: Message flow in Shuffle grouping
Date Sun, 10 Apr 2016 09:33:06 GMT
hi Anshu.  Can you please clarify what is "not clear" to you in the
description?

On Sun, Apr 10, 2016 at 2:31 AM, anshu shukla <anshushukla0@gmail.com>
wrote:

> Thanks Xiang,
>
> I  have read it already . But I am not clear about this point -
>
>
>    1. *Local or shuffle grouping: If the target bolt has one or more
>    tasks in the same worker process, tuples will be shuffled to just those
>    in-process tasks. Otherwise, this acts like a normal shuffle grouping*
>
>
> On Sun, Apr 10, 2016 at 6:55 AM, Xiang Wang <xiangw.cs@gmail.com> wrote:
>
>> Hi,
>>
>> Please have a look at this page:
>> http://storm.apache.org/releases/0.10.0/Concepts.html
>>
>> There are many different grouping methods, and direct grouping may be
>> what you are looking for.
>>
>>
>> -------------------------------
>> Xiang Wang PhD Candidate
>> Database Research Group
>> School of Computer Science and Engineering
>> The University of New South Wales
>> Sydney, Australia
>>
>> On Sun, Apr 10, 2016 at 7:14 AM, anshu shukla <anshushukla0@gmail.com>
>> wrote:
>>
>>> Suppose we have 10 exec/threads of spouts sending tuples to 5 threads of
>>> downstream bolt (say B) .Then my question is -
>>>
>>> *Does every thread of spout will uniformly distribute messages to all
>>> the 5 threads of  downstream nodes .*
>>>
>>> *Or *
>>>
>>> *Is  there  any one to one communication  btw spouts exec to bolts .*
>>>
>>>
>>> Very relevant if we want to improve N/W cost by custom scheduler in
>>> storm.
>>>
>>> --
>>> Thanks & Regards,
>>> Anshu Shukla
>>>
>>
>>
>
>
> --
> Thanks & Regards,
> Anshu Shukla
>

Mime
View raw message