beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aromane...@apache.org
Subject [beam] branch master updated (2fbb1ee -> 288c95f)
Date Thu, 16 May 2019 15:42:30 GMT
This is an automated email from the ASF dual-hosted git repository.

aromanenko pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 2fbb1ee  [BEAM-7287] Change JAVA_HOME to match new Jenkins agents (#8584)
     add 9fe0a03  Modified KinesisIO to use WatermarkPolicyFactory for watermark computation.
Added tests
     new 288c95f  Merge pull request #8513: [BEAM-7240] Kinesis IO Watermark Computation Improvements

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/java/io/kinesis/build.gradle                  |   1 +
 .../org/apache/beam/sdk/io/kinesis/KinesisIO.java  |  89 ++++++++++++
 .../apache/beam/sdk/io/kinesis/KinesisReader.java  |  21 ++-
 .../apache/beam/sdk/io/kinesis/KinesisSource.java  |   7 +
 .../beam/sdk/io/kinesis/KinesisWatermark.java      | 116 ----------------
 .../beam/sdk/io/kinesis/ShardReadersPool.java      |  27 ++--
 .../beam/sdk/io/kinesis/ShardRecordsIterator.java  |  24 +++-
 .../beam/sdk/io/kinesis/WatermarkParameters.java   |  98 +++++++++++++
 ...inesisPartitioner.java => WatermarkPolicy.java} |  10 +-
 .../sdk/io/kinesis/WatermarkPolicyFactory.java     | 152 +++++++++++++++++++++
 .../beam/sdk/io/kinesis/KinesisMockReadTest.java   |   1 +
 .../beam/sdk/io/kinesis/KinesisReaderTest.java     |  41 ++----
 .../beam/sdk/io/kinesis/KinesisWatermarkTest.java  | 138 -------------------
 .../beam/sdk/io/kinesis/ShardReadersPoolTest.java  |  61 +++++----
 .../sdk/io/kinesis/ShardRecordsIteratorTest.java   |  16 ++-
 .../beam/sdk/io/kinesis/WatermarkPolicyTest.java   | 152 +++++++++++++++++++++
 16 files changed, 616 insertions(+), 338 deletions(-)
 delete mode 100644 sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/KinesisWatermark.java
 create mode 100644 sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/WatermarkParameters.java
 copy sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/{KinesisPartitioner.java
=> WatermarkPolicy.java} (78%)
 create mode 100644 sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/WatermarkPolicyFactory.java
 delete mode 100644 sdks/java/io/kinesis/src/test/java/org/apache/beam/sdk/io/kinesis/KinesisWatermarkTest.java
 create mode 100644 sdks/java/io/kinesis/src/test/java/org/apache/beam/sdk/io/kinesis/WatermarkPolicyTest.java


Mime
View raw message