beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Kirpichov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2841) NPE in Dataflow job
Date Tue, 05 Sep 2017 22:40:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154497#comment-16154497
] 

Eugene Kirpichov commented on BEAM-2841:
----------------------------------------

This is a duplicate of BEAM-2834.

> NPE in Dataflow job
> -------------------
>
>                 Key: BEAM-2841
>                 URL: https://issues.apache.org/jira/browse/BEAM-2841
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-gcp
>    Affects Versions: 2.1.0
>            Reporter: Coda Hale
>            Assignee: Chamikara Jayalath
>             Fix For: 2.2.0
>
>
> My Dataflow job just started throwing exceptions after an unrelated update:
> {{java.lang.NullPointerException        org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:759)
       org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl.insertAll(BigQueryServicesImpl.java:809)
       org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn.flushRows(StreamingWriteFn.java:126)
       org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn.finishBundle(StreamingWriteFn.java:96)}}
> The only change was to convert a {{DoFn<String, TableRow>}} to a {{DoFn<PubsubMessage,
TableRow>}} and use {{PubsubIO.readMessages}} instead of {{PubsubIO.readString}}.
> Any ideas?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message