beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Baptiste Onofré (JIRA) <j...@apache.org>
Subject [jira] [Created] (BEAM-638) Add a Window function to create a bounded PCollection from an unbounded one
Date Mon, 19 Sep 2016 15:33:21 GMT
Jean-Baptiste Onofré created BEAM-638:
-----------------------------------------

             Summary: Add a Window function to create a bounded PCollection from an unbounded
one
                 Key: BEAM-638
                 URL: https://issues.apache.org/jira/browse/BEAM-638
             Project: Beam
          Issue Type: New Feature
          Components: sdk-java-core
            Reporter: Jean-Baptiste Onofré
            Assignee: Davor Bonaci


Today, if the pipeline source is unbounded, and the sink expects a bounded collection, there's
no way to use a single pipeline. Even a window creates a chunk on the unbounded PCollection,
but the "sub" PCollection is still unbounded.
It would be helpful for users to have a Window function that create a bounded PCollection
(on the window) from an unbounded PCollection coming from the source.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message