beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (BEAM-5528) Java PortableRunner pipeline fails on FlinkRunner due to CREATE_VIEW
Date Sun, 30 Sep 2018 23:42:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-5528?focusedWorklogId=149871&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-149871
]

ASF GitHub Bot logged work on BEAM-5528:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 30/Sep/18 23:41
            Start Date: 30/Sep/18 23:41
    Worklog Time Spent: 10m 
      Work Description: tweise commented on issue #6523: [BEAM-5528] Re-add CREATE_VIEW in
portable Flink translators
URL: https://github.com/apache/beam/pull/6523#issuecomment-425761165
 
 
   There was discussion about this on the slack channel. Essentially this is an issue with
the Java SDK, it should not generate this URN (at least not for portable pipelines). Can you
please check what it takes to fix the root cause?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 149871)
    Time Spent: 20m  (was: 10m)

> Java PortableRunner pipeline fails on FlinkRunner due to CREATE_VIEW
> --------------------------------------------------------------------
>
>                 Key: BEAM-5528
>                 URL: https://issues.apache.org/jira/browse/BEAM-5528
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>            Priority: Major
>              Labels: portability-flink
>             Fix For: 2.8.0
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> We recently removed the CREATE_VIEW translation which was a NOOP. Turns out we still
need to support it until it is removed. 
> {noformat}
> java.lang.IllegalArgumentException: Unknown type of URN beam:transform:create_view:v1
for PTransform with id TextIO.Write/WriteFiles/GatherTempFileResults/View.AsList/View.CreatePCollectionView.
>         at org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.urnNotFound(FlinkBatchPortablePipelineTranslator.java:578)
>         at org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.translate(FlinkBatchPortablePipelineTranslator.java:233)
>         at org.apache.beam.runners.flink.FlinkJobInvocation.runPipeline(FlinkJobInvocation.java:112)
>         at org.apache.beam.repackaged.beam_runners_flink_2.11.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:111)
>         at org.apache.beam.repackaged.beam_runners_flink_2.11.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:58)
>         at org.apache.beam.repackaged.beam_runners_flink_2.11.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:75)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message