flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andreas C. Osowski (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3788) Local variable values are not distributed to job runners
Date Tue, 19 Apr 2016 15:06:25 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15247919#comment-15247919
] 

Andreas C. Osowski commented on FLINK-3788:
-------------------------------------------

In that case, the behaviour can probably be explained by: 

bq. It should be noted that this trait is implemented using the DelayedInit functionality,
which means that fields of the object will not have been initialized before the main method
has been executed.
Source: http://www.scala-lang.org/api/current/index.html#scala.App


> Local variable values are not distributed to job runners
> --------------------------------------------------------
>
>                 Key: FLINK-3788
>                 URL: https://issues.apache.org/jira/browse/FLINK-3788
>             Project: Flink
>          Issue Type: Bug
>          Components: DataSet API
>    Affects Versions: 1.0.0, 1.0.1
>         Environment: Scala 2.11.8
> Sun JDK 1.8.0_65 or OpenJDK 1.8.0_77
> Fedora 25, 4.6.0-0.rc2.git3.1.fc25.x86_64
>            Reporter: Andreas C. Osowski
>         Attachments: FLINK-3788.tgz
>
>
> Variable values of non-elementary types aren't caught and distributed to job runners,
causing them to remain 'null' and causing NPEs upon access when running on a cluster. Running
locally through `flink-clients` works fine.
> Changing parallelism or disabling the closure cleaner don't seem to have any effect.
> Minimal example, also see the attached archive.
> {code:java}
> case class IntWrapper(a1: Int)
> val wrapped = IntWrapper(42)
> env.readTextFile("myTextFile.txt").map(line => wrapped.toString).collect
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message