beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Frances Perry (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-1624) Unable to deserialize Coder in DataflowRunner
Date Sun, 05 Mar 2017 07:41:32 GMT
Frances Perry created BEAM-1624:
-----------------------------------

             Summary: Unable to deserialize Coder in DataflowRunner
                 Key: BEAM-1624
                 URL: https://issues.apache.org/jira/browse/BEAM-1624
             Project: Beam
          Issue Type: Bug
          Components: runner-dataflow
            Reporter: Frances Perry
            Assignee: Davor Bonaci
            Priority: Blocker
             Fix For: 0.6.0


To repro, sync to head and run the LeaderBoard example with the Dataflow runner
Does not repro in 0.5.

Caused by: java.lang.RuntimeException: Unable to deserialize Coder: WindowedValue$FullWindowedValueCoder(KvCoder(BigQueryIO$ShardedKeyCoder(StringUtf8Coder),BigQueryIO$TableRowInfoCoder),IntervalWindow$IntervalWindowCoder).
Check that a suitable constructor is defined.  See Coder for details.
	at org.apache.beam.sdk.util.SerializableUtils.ensureSerializable(SerializableUtils.java:115)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$StepTranslator.addOutput(DataflowPipelineTranslator.java:655)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$StepTranslator.addOutput(DataflowPipelineTranslator.java:602)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator.translateOutputs(DataflowPipelineTranslator.java:945)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator.access$1200(DataflowPipelineTranslator.java:111)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$6.translateMultiHelper(DataflowPipelineTranslator.java:836)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$6.translate(DataflowPipelineTranslator.java:826)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$6.translate(DataflowPipelineTranslator.java:823)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator.visitPrimitiveTransform(DataflowPipelineTranslator.java:413)
	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:486)
	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:481)
	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:481)
	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:481)
	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:481)
	at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:481)
	at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$400(TransformHierarchy.java:231)
	at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:206)
	at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:321)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator.translate(DataflowPipelineTranslator.java:363)
	at org.apache.beam.runners.dataflow.DataflowPipelineTranslator.translate(DataflowPipelineTranslator.java:153)
	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:505)
	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:150)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:210)
	at org.apache.beam.examples.complete.game.GameStats.main(GameStats.java:340)
	... 6 more
Caused by: java.lang.RuntimeException: Unable to deserialize class interface org.apache.beam.sdk.coders.Coder
	at org.apache.beam.sdk.util.Serializer.deserialize(Serializer.java:102)
	at org.apache.beam.sdk.util.SerializableUtils.ensureSerializable(SerializableUtils.java:112)
	... 29 more



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message