drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Becker (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-229) Build a Merging Recevier
Date Wed, 25 Sep 2013 18:30:06 GMT

     [ https://issues.apache.org/jira/browse/DRILL-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ben Becker updated DRILL-229:
-----------------------------

    Description: 
Build a merging receiver operator which combines a number of incoming buffers into a single
output stream by merging the streams based on equality of one or more expressions.

The following example illustrates a distributed count operation, where each remote fragment
counts a subset of the data and the root fragment produces a sum of each count aggregate.

h4. Data Flow
{noformat}
RecordReader
  |
  +-> Sort
       |
       +-> StreamingAggregate(COUNT)
              |
              +-> MergingPartitionExchange
                     |
                     +-> StreamingAggregate(SUM)
                            |
                            +-> UnionExchange
                                   |
                                   +-> Screen
{noformat}

h4. Control Flow

{noformat}
Root Fragment
-------------
Screen
   |
   +->UnionExchange
         | | |
         | | +->AggSum
         | |      |
         | |      +->MergingReceiver
         | |
         | +--->AggSum
         |        |
         |        +->MergingReceiver
         |
         +----->AggSum
                  |
                  +->MergingReceiver
             ...

Remote Fragment
---------------
PartitionSender
       |
       +->AggCount
             |
             +->Sort
                 |
                 +->Reader
{noformat}


  was:Build a merging receiver operator which combines a number of incoming buffers into a
single output stream by merging the streams based on equality of one or more expressions

    
> Build a Merging Recevier
> ------------------------
>
>                 Key: DRILL-229
>                 URL: https://issues.apache.org/jira/browse/DRILL-229
>             Project: Apache Drill
>          Issue Type: New Feature
>            Reporter: Jacques Nadeau
>            Assignee: Ben Becker
>
> Build a merging receiver operator which combines a number of incoming buffers into a
single output stream by merging the streams based on equality of one or more expressions.
> The following example illustrates a distributed count operation, where each remote fragment
counts a subset of the data and the root fragment produces a sum of each count aggregate.
> h4. Data Flow
> {noformat}
> RecordReader
>   |
>   +-> Sort
>        |
>        +-> StreamingAggregate(COUNT)
>               |
>               +-> MergingPartitionExchange
>                      |
>                      +-> StreamingAggregate(SUM)
>                             |
>                             +-> UnionExchange
>                                    |
>                                    +-> Screen
> {noformat}
> h4. Control Flow
> {noformat}
> Root Fragment
> -------------
> Screen
>    |
>    +->UnionExchange
>          | | |
>          | | +->AggSum
>          | |      |
>          | |      +->MergingReceiver
>          | |
>          | +--->AggSum
>          |        |
>          |        +->MergingReceiver
>          |
>          +----->AggSum
>                   |
>                   +->MergingReceiver
>              ...
> Remote Fragment
> ---------------
> PartitionSender
>        |
>        +->AggCount
>              |
>              +->Sort
>                  |
>                  +->Reader
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message