beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From manuzhang <>
Subject [GitHub] incubator-beam pull request #1507: merge master into gearpump-runner branch
Date Mon, 05 Dec 2016 09:16:51 GMT
GitHub user manuzhang opened a pull request:

    merge master into gearpump-runner branch

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull gearpump-runner-sync

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1507
commit 73d0af9151340d85df1f720e88366f8a463b44bc
Author: Thomas Groh <>
Date:   2016-11-23T00:14:29Z

    Add TransformHierarchyTest
    This tests basic features of TransformHierarchy

commit 3ae9425b3a36e34890980647952c61cedbd91ff3
Author: Kenneth Knowles <>
Date:   2016-11-23T06:24:37Z

    This closes #1425

commit 09986e9433d49812d5061fe6543dff90d78eba6a
Author: Kenneth Knowles <>
Date:   2016-11-23T06:16:29Z

    Use more natural class to find class loader in ReflectHelpers

commit 5f3e7787d7e724b827af8924b2773ed3b5c2b036
Author: Luke Cwik <>
Date:   2016-11-23T15:42:13Z

    Use more natural class to find class loader in ReflectHelpers
    This closes #1427

commit 2e2146b1869807d69658592de8ed5ff339c28507
Author: Thomas Weise <>
Date:   2016-11-22T19:38:00Z

    Update transitive dependencies for Apex 3.5.0 snapshot version.

commit 26a30a22d28e034d16b5f0c4ea0be1b4f8c464f6
Author: Kenneth Knowles <>
Date:   2016-11-23T17:56:17Z

    This closes #1418

commit ef74e192eaee79e4cb8c7c901a296dd76559d76d
Author: Daniel Kulp <>
Date:   2016-11-22T18:31:19Z

    [BEAM-1034] Clean up tmp area in tests

commit 6d0c205a306d6cdca346fe2aaf662b03b4959a0e
Author: Jean-Baptiste Onofré <>
Date:   2016-11-24T07:43:09Z

    [BEAM-1034] This closes #1415

commit 7b314aad1c7c62ad61e09e610c60f53ac056d75d
Author: Jean-Baptiste Onofré <>
Date:   2016-11-17T16:07:21Z

    [BEAM-959] Improve validation messages in JdbcIO

commit 3e4b2fd0d96ff2757de7782b7c80dc1881eb451b
Author: Jean-Baptiste Onofré <>
Date:   2016-11-24T09:31:52Z

    [BEAM-959] This closes #1374

commit 4a097729ac9fc65283f4f11f85812188589c8df3
Author: Aljoscha Krettek <>
Date:   2016-11-08T10:03:21Z

    Replace WindowAssignment OldDoFn by FlatMap in Flink Runner
    The streaming runner had an OldDoFn that was used for assigning windows
    using a WindowFn. This is now done with a FlatMap.

commit 8d1214a3ba94b21102b74d346e73f24ecd9056f2
Author: Aljoscha Krettek <>
Date:   2016-11-24T14:20:49Z

    This closes #1435

commit 8d7d46c6e407c738a61b236078d002d178da0b9f
Author: manuzhang <>
Date:   2016-11-23T01:24:05Z

    [BEAM-800] add getFn to DoFnInvoker

commit 632576b5be00f050ff86981bfe55b170dec41759
Author: Kenneth Knowles <>
Date:   2016-11-26T04:34:12Z

    This closes #1428

commit 07544ef3a47bbdfacc00c75af875c3533a5fe477
Author: Kenneth Knowles <>
Date:   2016-11-23T19:22:08Z

    Remove unused body of StreamingPCollectionViewWriterFn

commit 803bbe2a3026424f509e13809a8eecb79990e5fe
Author: Kenneth Knowles <>
Date:   2016-11-23T19:23:07Z

    Remove unused WindowingInternals.writePCollectionViewData

commit 3ad7677503977108b5a67c315bd1cc6ead3ee998
Author: Sela <>
Date:   2016-11-26T10:50:01Z

    [BEAM-498] Remove obsolete WindowingInternals#writePCollectionViewData
    This closes #1430

commit cc96b1381b6db849adf69daddecf30b9c61acf73
Author: Ismaël Mejía <>
Date:   2016-11-25T13:52:26Z

    [BEAM-851] Determine if the pipeline must be translated into streaming mode (if not set)
    Now an Evaluator (visitor) detects if there are Unbonded.Read transforms.
    This approach is based on Flink's PipelineTranslationOptimizer

commit 8cc43aa701807009ec826e752b2f1bb95442450f
Author: Sela <>
Date:   2016-11-27T11:19:59Z

    This closes #1436

commit f6005593ccf6bdef7c975622d5af39792c7db44c
Author: Ismaël Mejía <>
Date:   2016-11-27T10:39:08Z

    [BEAM-1049] Update spark version to 1.6.3

commit 9fbd2d24e532221fdbe7ed29f62f315fd4a1eab1
Author: Jean-Baptiste Onofré <>
Date:   2016-11-27T17:53:10Z

    [BEAM-1049] This closes #1437

commit 7502adda3262bce9d6d4fe4499bde8d8b5273029
Author: Kenneth Knowles <>
Date:   2016-11-23T00:01:45Z

    Add input type to TransformResult
    This would likely have caught some hard-to-diagnose type safety errors
    during the development of StatefulParDoEvaluatorFactory, so adding it
    should hopefully catch similar bugs in the future.

commit 5e9a80cf61c4666edb5febd9a0fface2d2c26261
Author: Thomas Groh <>
Date:   2016-11-28T18:06:31Z

    This closes #1424

commit 1b7b065f4ccae7c52934b1e73fd1fbfb33c3398d
Author: Kenneth Knowles <>
Date:   2016-11-21T19:34:45Z

    Remove overspecified type in ParDoEvaluator

commit e17dc4af9f7de717872d6c6f0ab52e0498f3b782
Author: Kenneth Knowles <>
Date:   2016-11-10T05:10:51Z

    Add State parameter support to SimpleDoFnRunner

commit 7e158e4e583372dd79ffaa380ac7c2dbb4846c50
Author: Kenneth Knowles <>
Date:   2016-11-21T23:41:27Z

    Add simple tests for stateful ParDo

commit ec2c0e0698c1380b309a609eb642aba445c77e27
Author: Kenneth Knowles <>
Date:   2016-11-10T05:59:15Z

    Add support for Stateful ParDo in the Direct runner
    This adds overrides and new evaluators to ensure that
    state is accessed in a single-threaded manner per key
    and is cleaned up when a window expires.

commit 33c687069adc1ce4481a0c9637b2a77abb9450b8
Author: Kenneth Knowles <>
Date:   2016-11-28T21:03:51Z

    This closes #1399

commit 14502a3122bd1c1652196881797ffb60d480164e
Author: Scott Wegner <>
Date:   2016-11-22T16:56:17Z

    Add direct runner dependency to starter archetype

commit d5aeee9c17a75307ff539e40b3ddc176790ec559
Author: Thomas Groh <>
Date:   2016-11-28T21:17:46Z

    This closes #1414


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message