beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bhule...@apache.org
Subject [beam] branch master updated (6ff5d80 -> 28c2c77)
Date Tue, 07 Jul 2020 19:43:31 GMT
This is an automated email from the ASF dual-hosted git repository.

bhulette pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 6ff5d80  [BEAM-9754] Adds Python 3.8 ValidatesRunner tests for Dataflow.
     add 28c2c77  [BEAM-10336,BEAM-10337] Add SchemaIO abstraction and implement for PubSub
(#12090)

No new revisions were added by this update.

Summary of changes:
 .../InvalidConfigurationException.java}            |  21 +-
 .../InvalidSchemaException.java}                   |  21 +-
 .../sdk/schemas/io/SchemaCapableIOProvider.java    |  51 ++++
 .../org/apache/beam/sdk/schemas/io/SchemaIO.java   |  51 ++++
 .../apache/beam/sdk/schemas/io}/package-info.java  |   4 +-
 .../meta/provider/pubsub/PubsubIOJsonTable.java    |  77 +-----
 .../provider/pubsub/PubsubJsonTableProvider.java   | 159 +++----------
 .../sdk/io/gcp}/pubsub/PubsubMessageToRow.java     |   7 +-
 .../gcp/pubsub/PubsubSchemaCapableIOProvider.java  | 257 +++++++++++++++++++++
 .../sdk/io/gcp}/pubsub/RowToPubsubMessage.java     |  33 ++-
 .../sdk/io/gcp}/pubsub/PubsubMessageToRowTest.java |  15 +-
 11 files changed, 458 insertions(+), 238 deletions(-)
 copy sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/{Factory.java => io/InvalidConfigurationException.java}
(69%)
 copy sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/{Factory.java => io/InvalidSchemaException.java}
(70%)
 create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/io/SchemaCapableIOProvider.java
 create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/io/SchemaIO.java
 copy {runners/core-java/src/main/java/org/apache/beam/runners/core => sdks/java/core/src/main/java/org/apache/beam/sdk/schemas/io}/package-info.java
(91%)
 rename sdks/java/{extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/meta/provider
=> io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp}/pubsub/PubsubMessageToRow.java
(97%)
 create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubSchemaCapableIOProvider.java
 rename sdks/java/{extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/meta/provider
=> io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp}/pubsub/RowToPubsubMessage.java
(69%)
 rename sdks/java/{extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/meta/provider
=> io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp}/pubsub/PubsubMessageToRowTest.java
(95%)


Mime
View raw message