flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1531) Custom Kryo Serializer fails in itertation scenario
Date Thu, 12 Feb 2015 15:58:11 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318430#comment-14318430
] 

ASF GitHub Bot commented on FLINK-1531:
---------------------------------------

GitHub user tillrohrmann opened a pull request:

    https://github.com/apache/flink/pull/391

    [FLINK-1531] Fixes KryoSerializer's EOFException forwarding

    Adds proper EOFException forwarding to the KryoSerializer.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/tillrohrmann/flink fixKryoUnderflow

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/391.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #391
    
----
commit 8e9c94b50c55f31c311d60ff63bd42108962e9a4
Author: Till Rohrmann <trohrmann@apache.org>
Date:   2015-02-12T15:50:46Z

    [FLINK-1531] [runtime] Adds proper EOFException forwarding to KryoSerializer.

----


> Custom Kryo Serializer fails in itertation scenario
> ---------------------------------------------------
>
>                 Key: FLINK-1531
>                 URL: https://issues.apache.org/jira/browse/FLINK-1531
>             Project: Flink
>          Issue Type: Bug
>          Components: Iterations
>    Affects Versions: 0.9
>            Reporter: Johannes
>            Priority: Minor
>         Attachments: TestKryoIterationSerializer.java
>
>
> When using iterations with a custom serializer for a domain object, the iteration will
fail.
> {code:java}
> org.apache.flink.runtime.client.JobExecutionException: com.esotericsoftware.kryo.KryoException:
Buffer underflow
> 	at org.apache.flink.api.java.typeutils.runtime.NoFetchingInput.require(NoFetchingInput.java:76)
> 	at com.esotericsoftware.kryo.io.Input.readVarInt(Input.java:355)
> 	at com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:109)
> 	at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:641)
> 	at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752)
> 	at org.apache.flink.api.java.typeutils.runtime.KryoSerializer.deserialize(KryoSerializer.java:198)
> 	at org.apache.flink.api.java.typeutils.runtime.KryoSerializer.deserialize(KryoSerializer.java:203)
> 	at org.apache.flink.runtime.io.disk.InputViewIterator.next(InputViewIterator.java:43)
> 	at org.apache.flink.runtime.iterative.task.IterationHeadPactTask.streamOutFinalOutputBulk(IterationHeadPactTask.java:404)
> 	at org.apache.flink.runtime.iterative.task.IterationHeadPactTask.run(IterationHeadPactTask.java:377)
> 	at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:360)
> 	at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:204)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message