beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From echauc...@apache.org
Subject [beam] branch spark-runner_structured-streaming updated (e5921c5 -> 3533c89)
Date Wed, 03 Apr 2019 08:22:04 GMT
This is an automated email from the ASF dual-hosted git repository.

echauchot pushed a change to branch spark-runner_structured-streaming
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from e5921c5  Added TODO comment for ReshuffleTranslatorBatch
     new 8658ada  And unchecked warning suppression
     new 356280d  Add streaming source initialisation
     new 1530f7a  Start streaming source
     new 508e154  Add a TODO on spark output modes
     new 8957b7b  Add transformators registry in PipelineTranslatorStreaming
     new 3533c89  Add source streaming test

The 19453 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../translation/TranslationContext.java            |   2 +
 .../translation/batch/DatasetSourceBatch.java      |   4 +-
 .../streaming/DatasetSourceStreaming.java          | 147 +++++++++++++++++----
 .../streaming/PipelineTranslatorStreaming.java     |  52 +++++++-
 .../SimpleSourceTest.java}                         |  22 +--
 5 files changed, 183 insertions(+), 44 deletions(-)
 copy runners/spark-structured-streaming/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/{batch/WindowAssignTest.java
=> streaming/SimpleSourceTest.java} (73%)


Mime
View raw message