beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kamil Szewczyk (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-3406) FIeBasedIO IT fails due to "BigQuery error"
Date Fri, 12 Jan 2018 16:31:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324195#comment-16324195
] 

Kamil Szewczyk commented on BEAM-3406:
--------------------------------------

Hi, [~alanmyrvold] could you also create this tables in BigQuery ? 

beam_performance.textioit_hdfs_pkb_results
beam_performance.compressed_textioit_hdfs_pkb_results
beam_performance.avroioit_hdfs_pkb_results
beam_performance.tfrecordioit_hdfs_pkb_results

We will need them for another set of filebased io test running, but running on different filesystem.

It's descibded in more detailed way in https://github.com/apache/beam/pull/4401 

Thanks. 

> FIeBasedIO IT fails due to "BigQuery error"
> -------------------------------------------
>
>                 Key: BEAM-3406
>                 URL: https://issues.apache.org/jira/browse/BEAM-3406
>             Project: Beam
>          Issue Type: Bug
>          Components: testing
>            Reporter: Chamikara Jayalath
>            Assignee: Ɓukasz Gajowy
>             Fix For: Not applicable
>
>         Attachments: schema, textioit
>
>
> For example, 
> https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_FileBasedIO_IT/54/console
> beam_performance.filebasedioit_pkb_results /tmp/perfkitbenchmarker/runs/e2e3d02d/perfkit-bq-pub3ntgN3.json.
Got return code (1).
> STDOUT: BigQuery error in load operation: No schema specified on job or table.
> STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
UserWarning: You have requested explicit scopes to be used with a GCE service account.
> Using this argument will have no effect on the actual scopes for tokens
> requested. These scopes are set at VM instance creation time and
> can't be overridden in the request.
>   warnings.warn(_SCOPES_WARNING)
> Lukasz and Darek, can you take a look ?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message