beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Johston (JIRA)" <>
Subject [jira] [Created] (BEAM-2390) allow user to use .setTimePartitioning in BigQueryIO.write
Date Tue, 30 May 2017 22:48:04 GMT
Eric Johston created BEAM-2390:

             Summary: allow user to use .setTimePartitioning in BigQueryIO.write
                 Key: BEAM-2390
             Project: Beam
          Issue Type: Improvement
          Components: beam-model-runner-api
    Affects Versions: 2.0.0
            Reporter: Eric Johston
            Assignee: Kenneth Knowles
             Fix For: 2.0.0

Currently when writing to a table with BigQueryIO sink, there is no way to create a new table
that is date partitioned. This would be very useful, since currently the only way to do this
is  by manually creating a table ahead of time. We should be able to leverage the automatic
table creation functionality for date partitioned tables.

The best way to do this would be to have a withTimePartitioning method in the BigQueryIO class.

This message was sent by Atlassian JIRA

View raw message