beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From github-...@apache.org
Subject [beam] tag nightly-master updated (f23ebad -> f137246)
Date Wed, 16 Dec 2020 04:10:14 GMT
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.


*** WARNING: tag nightly-master was modified! ***

    from f23ebad  (commit)
      to f137246  (commit)
    from f23ebad  [BEAM-10641] Add Combiner Packing to Dataflow (#13455)
     add eb16936  [BEAM-11230] Fix a bug with decoding repeated fields (#13544)
     add 447d9ae  Enable more tests on Java + Python FnRunner
     add 531cded  Merge pull request #13547 from [BEAM-10450][BEAM-10449][BEAM-10453][BEAM-10995]
Enable more Java tests on Python FnRunner
     add ba11ed7  Do not add unnecessary experiment use_multiple_sdk_containers. (#13475)
     add 7e09870  Skip dynamic timer test in portable spark test
     add 5878cc5  Merge pull request #13553 from Skip dynamic timer test in portable spark
test
     add 3d62aab  Bump up python container versions
     add 3710357  Merge pull request #13552 from Bump up python container versions
     add 9f97585  [BEAM-11360] Updates Dataflow Python multi-language pipelines to use portable
job submission by default (#13536)
     add 8dd9b38  [BEAM-11401][BEAM-11366] Change ReaderCache invalidations to be asynchronous
and make the timeout configurable.
     add 0548643  Merge pull request #13485: [BEAM-11401][BEAM-11366] Change ReaderCache invalidations
to be async…
     add 5184eac  Revert "Do not add unnecessary experiment use_multiple_sdk_containers."
(#13555)
     add c60b70e  Adding limitations of SchemaUpdateOptions to BQIO javadoc.
     add 5d9f4de  Merge pull request #13551 from Adding limitations of SchemaUpdateOptions
to BQIO javadoc.
     add 15ffb07  [BEAM-11472] Support SDF on non-splitting runners such as legacy Dataflow.
     add f137246  Merge pull request #13556 [BEAM-11472] Support SDF on non-splitting runners
such as legacy Dataflow.

No new revisions were added by this update.

Summary of changes:
 .../options/DataflowPipelineDebugOptions.java      |  10 ++
 .../beam/runners/dataflow/worker/ReaderCache.java  |  38 +++---
 .../dataflow/worker/StreamingDataflowWorker.java   |   7 +-
 .../runners/dataflow/worker/ReaderCacheTest.java   |   6 +-
 .../worker/StreamingModeExecutionContextTest.java  |   3 +-
 .../dataflow/worker/WorkerCustomSourcesTest.java   |   2 +-
 runners/portability/java/build.gradle              |  24 ----
 .../beam/sdk/io/gcp/bigquery/BigQueryIO.java       |   7 +-
 sdks/python/apache_beam/coders/coders.py           |  69 +----------
 .../apache_beam/coders/coders_test_common.py       |   1 -
 sdks/python/apache_beam/coders/typecoders.py       |   3 -
 .../flink/flink_streaming_impulse_source_test.py   |   3 +-
 .../apache_beam/io/gcp/bigquery_read_internal.py   |  40 +++---
 sdks/python/apache_beam/io/gcp/bigquery_test.py    |  12 ++
 sdks/python/apache_beam/io/restriction_trackers.py |   2 +-
 sdks/python/apache_beam/pipeline.py                | 124 +++++++------------
 sdks/python/apache_beam/runners/common.py          |   8 ++
 .../runners/dataflow/dataflow_runner.py            | 136 ++++++---------------
 .../apache_beam/runners/dataflow/internal/names.py |   4 +-
 .../python/apache_beam/runners/pipeline_context.py |   2 -
 .../runners/portability/spark_runner_test.py       |   3 +
 sdks/python/apache_beam/transforms/core.py         |  91 --------------
 sdks/python/apache_beam/transforms/environments.py |  15 +--
 sdks/python/apache_beam/transforms/external.py     |  24 ++--
 sdks/python/apache_beam/transforms/ptransform.py   |  16 +--
 .../typehints/native_type_compatibility.py         |   7 --
 26 files changed, 208 insertions(+), 449 deletions(-)


Mime
View raw message