beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From boyu...@apache.org
Subject [beam] branch master updated (c8d2162 -> ed39236)
Date Fri, 17 Jul 2020 19:10:07 GMT
This is an automated email from the ASF dual-hosted git repository.

boyuanz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from c8d2162  Merge pull request #12256 from ibzib/BEAM-10487
     new 698401c  Insert TruncateSizedRestriction when pipeline starts to drain.
     new 0240471  Address latest comments.
     new 047bed7  SpotlessApply
     new 280e33d  Fix java build.
     new cf02dad  spotlessApply
     new 9b66b72  Only forward split/progress when the only consumer is splittable.
     new ed39236  Merge pull request #12287 from boyuanzz/drain_java

The 27905 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../pipeline/src/main/proto/beam_runner_api.proto  |  10 +
 .../runners/core/construction/Environments.java    |   2 +
 .../core/construction/PTransformTranslation.java   |   5 +
 .../core/construction/ParDoTranslation.java        |   3 +
 .../graph/SplittableParDoExpander.java             | 232 +++++++++
 .../core/construction/EnvironmentsTest.java        |   7 +
 .../core/construction/SplittableParDoTest.java     |   5 +
 .../graph/SplittableParDoExpanderTest.java         |  56 ++
 .../runners/core/SplittableParDoProcessFnTest.java |   5 +
 .../fnexecution/control/RemoteExecutionTest.java   |   5 +
 .../src/main/java/org/apache/beam/sdk/io/Read.java |  15 +-
 .../java/org/apache/beam/sdk/transforms/DoFn.java  |  57 +++
 .../beam/sdk/transforms/PeriodicSequence.java      |   5 +
 .../java/org/apache/beam/sdk/transforms/Watch.java |   8 +
 .../reflect/ByteBuddyDoFnInvokerFactory.java       |  30 +-
 .../beam/sdk/transforms/reflect/DoFnInvoker.java   |   6 +
 .../beam/sdk/transforms/reflect/DoFnSignature.java |  32 ++
 .../sdk/transforms/reflect/DoFnSignatures.java     |  82 +++
 .../splittabledofn/ByteKeyRangeTracker.java        |   5 +
 .../splittabledofn/GrowableOffsetRangeTracker.java |   9 +
 .../splittabledofn/OffsetRangeTracker.java         |   5 +
 .../splittabledofn/RestrictionTracker.java         |  30 ++
 .../sdk/transforms/reflect/DoFnInvokersTest.java   | 240 ++++++++-
 .../reflect/DoFnSignaturesSplittableDoFnTest.java  | 131 +++++
 .../GrowableOffsetRangeTrackerTest.java            |  20 +
 .../sdk/fn/splittabledofn/RestrictionTrackers.java |   5 +
 .../fn/splittabledofn/RestrictionTrackersTest.java |  10 +
 .../apache/beam/fn/harness/FnApiDoFnRunner.java    | 353 +++++++++----
 .../beam/fn/harness/FnApiDoFnRunnerTest.java       | 570 +++++++++++++++++++++
 29 files changed, 1828 insertions(+), 115 deletions(-)


Mime
View raw message