beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-2333) Rehydrate Pipeline from Runner API proto
Date Wed, 24 May 2017 04:29:04 GMT


ASF GitHub Bot commented on BEAM-2333:

GitHub user kennknowles opened a pull request:

    [BEAM-2333] Use URN to get RootInputProvider in Java DirectRunner

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`.
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](
    This is built on #3195. It adjusts another registry to be agnostic as to whether the transforms
are original Java transforms or perhaps not Java at all.
    R: @tgroh 

You can merge this pull request into a Git repository by running:

    $ git pull DirectRunner-RootInputProvider

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3217
commit 25bfac30c8fa90dec8ad25eb8248c67bb085c5fa
Author: Kenneth Knowles <>
Date:   2017-05-20T04:35:43Z

    Make SdkComponents public for TransformPayloadTranslator

commit 8e9d864dc4d94d4f0b61c7e814d509628c25be28
Author: Kenneth Knowles <>
Date:   2017-05-23T22:26:44Z

    Rename PCollections to PCollectionTranslation
    This is to give a standard and obvious suffix for all our helper classes
    for translating to/from Runner API protos.

commit d0f58e3c78fb1908a21fa81eb6d3088a622fbdc6
Author: Kenneth Knowles <>
Date:   2017-05-23T22:28:08Z

    Rename PTransforms to PTransformTranslation

commit 409f5ee6310ba6e9c72876050f5fbc53467712d2
Author: Kenneth Knowles <>
Date:   2017-05-23T22:28:49Z

    Rename ParDos to ParDoTranslation

commit cdd48237ee2c40fedf2eb2a80d91878276a804e6
Author: Kenneth Knowles <>
Date:   2017-05-23T22:29:16Z

    Rename WindowIntoTranslator to WindowIntoTranslation

commit 40b614335e0dfc248d633e1ce3ca1ca4441fccd2
Author: Kenneth Knowles <>
Date:   2017-05-23T22:30:22Z

    Rename ReadTranslator to ReadTranslation

commit 2c2117f83b0fad0d56862840a353c98ce3e387bf
Author: Kenneth Knowles <>
Date:   2017-05-20T03:54:36Z

    Centralize primitive URNs in PTransforms class

commit fb963245f72b6761bf27629a34db9321c4c38b06
Author: Kenneth Knowles <>
Date:   2017-05-20T03:55:25Z

    Allow getting URN for class of transform via translator

commit bfd07093f83e45c0055f8cf6eb4a63e566da0a5d
Author: Kenneth Knowles <>
Date:   2017-05-20T04:28:19Z

    Add RawPTransform, which can just vend its URN and payload
    This is the type that will be returned when a pipeline is deserialized.
    This also is convenient for direct runner overrides which do not really
    merit translator registrations, yet URNs need to be known in order to
    key the evaluator registry off URN.

commit 0f9c20751f96bb480637afb818444cadd19e8258
Author: Kenneth Knowles <>
Date:   2017-05-23T22:31:49Z

    Rename Coders to CoderTranslation

commit 2cb37ec1cff44d1d579afbd9896eacdd87381f54
Author: Kenneth Knowles <>
Date:   2017-05-23T22:32:47Z

    Rename WindowingStrategies to WindowingStrategyTranslation

commit ea6534269fc46bd1c89f8125201cc0f7ca2f5791
Author: Kenneth Knowles <>
Date:   2017-05-23T22:33:33Z

    Rename Triggers to TriggerTranslation

commit 183d1501b8b9923b9bba4ba1f98a8856899983bf
Author: Kenneth Knowles <>
Date:   2017-05-23T04:00:02Z

    Add registration for Read and WindowInto translators

commit aacb1fe367362c4c8fd0c04fb9cd99d5c858cfc7
Author: Kenneth Knowles <>
Date:   2017-05-23T04:09:20Z

    Register ReadTranslator

commit 081a4acb1bd36803902637d9efcb0b1c16c52f80
Author: Kenneth Knowles <>
Date:   2017-05-23T04:09:33Z

    Register WindowIntoTranslator

commit b6ff3438ebea518979ed120687fb3006426b82e6
Author: Kenneth Knowles <>
Date:   2017-05-23T04:09:54Z

    Add trivial FlattenTranslator to access URN

commit 9c08b1768dc31410756d0db895f0a3be7d8e16c7
Author: Kenneth Knowles <>
Date:   2017-05-20T03:53:32Z

    Use URNs in DirectRunner evaluator registry

commit e4a10964f1064fd216b389089aa8520816c31645
Author: Kenneth Knowles <>
Date:   2017-05-24T04:15:48Z

    Allow extraction of source from Read transform pre or post-hydration

commit 3620ad87cf45d4566f7e6c6a30384e82a6b95512
Author: Kenneth Knowles <>
Date:   2017-05-24T04:17:45Z

    DirectRunner RootInputProvider registry via URN


> Rehydrate Pipeline from Runner API proto
> ----------------------------------------
>                 Key: BEAM-2333
>                 URL:
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-core
>            Reporter: Kenneth Knowles
>            Assignee: Kenneth Knowles

This message was sent by Atlassian JIRA

View raw message