beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bhule...@apache.org
Subject [beam] 01/01: [BEAM-10407, 10408] SchemaIOTableProviderWrapper and implementations for Avro and Parquet (#12202)
Date Wed, 22 Jul 2020 19:22:57 GMT
This is an automated email from the ASF dual-hosted git repository.

bhulette pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 33f14ec1b315996b4569b4694a0ff5bf95626f8a
Merge: 8aca8cc bd915c7
Author: Brian Hulette <bhulette@google.com>
AuthorDate: Wed Jul 22 12:22:29 2020 -0700

    [BEAM-10407,10408] SchemaIOTableProviderWrapper and implementations for Avro and Parquet
(#12202)
    
    [BEAM-10407,10408] SchemaIOTableProviderWrapper and implementations for Avro and Parquet

 .../apache/beam/sdk/io/AvroSchemaIOProvider.java   | 126 +++++++++++++++++
 .../beam/sdk/io}/GenericRecordWriteConverter.java  |   2 +-
 .../beam/sdk/schemas/io/SchemaIOProvider.java      |   3 +
 .../provider/SchemaIOTableProviderWrapper.java     | 129 +++++++++++++++++
 .../sql/meta/provider/avro/AvroTable.java          |  82 -----------
 .../sql/meta/provider/avro/AvroTableProvider.java  |  23 +--
 .../sql/meta/provider/parquet/ParquetTable.java    |  68 ---------
 .../provider/parquet/ParquetTableProvider.java     |  23 +--
 .../meta/provider/pubsub/PubsubIOJsonTable.java    | 154 ---------------------
 .../provider/pubsub/PubsubJsonTableProvider.java   |  56 ++------
 ...IOProvider.java => PubsubSchemaIOProvider.java} |   7 +-
 .../sdk/io/gcp/pubsub/PubsubMessageToRowTest.java  |   2 +-
 .../io}/parquet/GenericRecordReadConverter.java    |   4 +-
 .../sdk/io/parquet/ParquetSchemaIOProvider.java    | 112 +++++++++++++++
 .../sdk/io}/parquet/GenericRecordToRowTest.java    |   2 +-
 15 files changed, 422 insertions(+), 371 deletions(-)


Mime
View raw message