beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2371) Make Java DirectRunner demonstrate language-agnostic Runner API translation wrappers
Date Fri, 26 May 2017 18:12:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16026618#comment-16026618
] 

ASF GitHub Bot commented on BEAM-2371:
--------------------------------------

GitHub user kennknowles opened a pull request:

    https://github.com/apache/beam/pull/3239

    [BEAM-2371] Port DirectRunner override matchers to language-agnostic construction APIs

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [x] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`.
     - [x] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [x] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
    
    ---
    
    R: @tgroh 

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/kennknowles/beam DirectRunner-matchers

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3239.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3239
    
----
commit 6342a36380d7a8f9f5990e680fce7c6c74f3d925
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:28:45Z

    Add splittability to ParDoPayload

commit 4dfb9ce6fd2252167d9923cff956b6731cc7bfba
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:29:16Z

    Auxiiliary URNs for SDF

commit fbe29f3e56c94d366ce8ebfb7576884acc022440
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:29:36Z

    Extract splittability via Runner API

commit cbc514e32f719188e581578b382cd33e32bc4d8a
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:30:00Z

    Some more somewhat standard URNs
    
    A test-only primitive: TestStream
    A deprecated primitive: CreateView
    A composite that the DirectRunner overrides: WriteFiles

commit 843f4531a9860a5f31ea9c18314ce0daf0b723f2
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:45:27Z

    Add GroupByKeyTranslation

commit 14b83a447e2d847740eb5ad50b8115636bc5190d
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:56:23Z

    Add CreatePCollectionViewTranslation

commit a9744d11746d32c63e9ea9aba6145a29c336fc50
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:56:32Z

    Add WriteFilesTranslation

commit d2e99713e92bf30ee5dfd36ae7eff79b5a42d69a
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-26T17:54:14Z

    Add TestStreamTranslation

commit ead03b3e8eb792d42e10a97006be05c53cda949c
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:29:09Z

    Add Runner API oriented PTransformMatchers for DirectRunner overrides

commit 72cb839a42b3df07829e988d861984ebcb157457
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-25T13:31:16Z

    DirectRunner override matchers using Runner API

----


> Make Java DirectRunner demonstrate language-agnostic Runner API translation wrappers
> ------------------------------------------------------------------------------------
>
>                 Key: BEAM-2371
>                 URL: https://issues.apache.org/jira/browse/BEAM-2371
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-direct
>            Reporter: Kenneth Knowles
>            Assignee: Kenneth Knowles
>
> This will complete the PoC for runners-core-construction-java and the Runner API and
show other runners the easy path to executing non-Java pipelines, modulo Fn API.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message