beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From peihe <>
Subject [GitHub] beam pull request #3276: Flink runner: support per transform parallelism thr...
Date Thu, 01 Jun 2017 07:47:32 GMT
GitHub user peihe opened a pull request:

    Flink runner: support per transform parallelism through PipelineOptions.

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`.
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull configuration-1

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3276
commit 24367f0def03e7c3a501d44ad2be866b3ba89caf
Author: Pei He <>
Date:   2017-05-27T09:06:07Z

    Flink runner: specify per transform parallelism through PipelineOptions.

commit 99c7752913db91da0b7c762c4dcf01ee258b5a4b
Author: Pei He <>
Date:   2017-06-01T03:08:42Z

    Flink runner: infer per transform parallelism in PipelineTranslationOptimizer.

commit 45d3ea012dd9ec5bc6525abb126e15c7825a77b2
Author: Pei He <>
Date:   2017-06-01T03:32:12Z

    Flink runner: override the translation context parallelism if perTransformParallelism
is found.

commit 403f89bfb16b38a6b2089f4574938a08fe30802e
Author: Pei He <>
Date:   2017-06-01T06:47:15Z

    Flink runner: use upStream parallelism for flatmap when translating GroupByKey and Combine.PerKey.


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message