flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2124) FromElementsFunction is not really Serializable
Date Thu, 05 Nov 2015 18:14:27 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992150#comment-14992150
] 

Maximilian Michels commented on FLINK-2124:
-------------------------------------------

Flink 0.9.1 has a custom serialization system that works independently of Java serialization
but, due to a bug, it is not correctly handled in the fromElements method. So you tried this
on the 0.10-SNAPSHOT, right?

The basic idea of the fix that we have in place is that we use Flink's type serialization
system to serialize all data before we pass the FromElements InputFromat to the ClojureCleaner.
The ClojureCleaner should then be fine with the serialized data.

Could you provide a minimal code example which I could debug? 

> FromElementsFunction is not really Serializable
> -----------------------------------------------
>
>                 Key: FLINK-2124
>                 URL: https://issues.apache.org/jira/browse/FLINK-2124
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming
>            Reporter: Aljoscha Krettek
>            Assignee: Johannes Reifferscheid
>             Fix For: 0.10
>
>
> The function stores an Iterable of T. T is not necessarily Serializable and and Iterable
is also not necessarily Serializable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message