beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Johston (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-2390) allow user to use .setTimePartitioning in BigQueryIO.write
Date Tue, 30 May 2017 22:48:04 GMT
Eric Johston created BEAM-2390:
----------------------------------

             Summary: allow user to use .setTimePartitioning in BigQueryIO.write
                 Key: BEAM-2390
                 URL: https://issues.apache.org/jira/browse/BEAM-2390
             Project: Beam
          Issue Type: Improvement
          Components: beam-model-runner-api
    Affects Versions: 2.0.0
            Reporter: Eric Johston
            Assignee: Kenneth Knowles
             Fix For: 2.0.0


Currently when writing to a table with BigQueryIO sink, there is no way to create a new table
that is date partitioned. This would be very useful, since currently the only way to do this
is  by manually creating a table ahead of time. We should be able to leverage the automatic
table creation functionality for date partitioned tables.

The best way to do this would be to have a withTimePartitioning method in the BigQueryIO class.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message