beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rober...@apache.org
Subject [beam] 01/01: Merge pull request #7078 from [BEAM-6094] External portable BeamPython.
Date Wed, 12 Dec 2018 12:02:19 GMT
This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit ec55000f2686aae9856c53863cf70b85bc1ed38d
Merge: 8c8b7c3 efd261a
Author: Robert Bradshaw <robertwb@gmail.com>
AuthorDate: Wed Dec 12 13:02:10 2018 +0100

    Merge pull request #7078 from [BEAM-6094] External portable BeamPython.
    
    [BEAM-6094] Implement external environment for portable BeamPython.

 .../fn-execution/src/main/proto/beam_fn_api.proto  |  20 ++
 .../pipeline/src/main/proto/beam_runner_api.proto  |   6 +
 .../FlinkDefaultExecutableStageContext.java        |   3 +
 ...actory.java => ExternalEnvironmentFactory.java} | 116 +++----
 .../environment/ProcessEnvironmentFactory.java     |   2 +-
 sdks/python/apache_beam/pipeline.py                |   9 +-
 sdks/python/apache_beam/portability/python_urns.py |  16 +
 .../python/apache_beam/runners/pipeline_context.py |   2 +-
 .../runners/portability/flink_runner_test.py       |   3 +-
 .../runners/portability/fn_api_runner.py           | 376 ++++++++++++++-------
 .../runners/portability/fn_api_runner_test.py      |  19 +-
 .../portability/fn_api_runner_transforms.py        |  48 ++-
 .../runners/portability/local_job_service.py       |  25 +-
 .../runners/portability/local_job_service_main.py  |   4 +-
 .../runners/portability/portable_runner.py         | 120 +++++--
 .../runners/portability/portable_runner_test.py    |  43 ++-
 .../apache_beam/runners/worker/sdk_worker.py       |   8 +-
 .../runners/worker/worker_id_interceptor.py        |   5 +-
 18 files changed, 560 insertions(+), 265 deletions(-)


Mime
View raw message