beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chamik...@apache.org
Subject [beam] branch release-2.28.0 updated (e5f3ee0 -> a7e598b)
Date Fri, 29 Jan 2021 22:09:17 GMT
This is an automated email from the ASF dual-hosted git repository.

chamikara pushed a change to branch release-2.28.0
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from e5f3ee0  Merge pull request #13828: [BEAM-11689] (release-2.28.0) Add public.nexus.pentaho.org
to offline repositories.
     add dda7c41  Merge pull request #13496 from [BEAM-11408] Integrate BigQuery sink streaming
inserts with GroupIntoBatches
     add a7e598b  Merge pull request #13832: [BEAM-11408] [cherry-pick] Integrate BigQuery
sink streaming inserts with GroupIntoBatches

No new revisions were added by this update.

Summary of changes:
 .../beam/runners/dataflow/DataflowRunner.java      |   4 +-
 .../sdk/io/gcp/bigquery/BatchedStreamingWrite.java | 403 +++++++++++++++++++++
 .../beam/sdk/io/gcp/bigquery/BigQueryIO.java       |  23 ++
 .../beam/sdk/io/gcp/bigquery/StreamingInserts.java |  29 ++
 .../beam/sdk/io/gcp/bigquery/StreamingWriteFn.java | 215 -----------
 .../sdk/io/gcp/bigquery/StreamingWriteTables.java  | 168 ++++++---
 .../beam/sdk/io/gcp/bigquery/TagWithUniqueIds.java |   8 +-
 .../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java   |  73 +++-
 8 files changed, 638 insertions(+), 285 deletions(-)
 create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BatchedStreamingWrite.java
 delete mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StreamingWriteFn.java


Mime
View raw message