flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Renkai Ge (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4883) Prevent UDFs implementations through Scala singleton objects
Date Thu, 27 Oct 2016 12:39:58 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15611756#comment-15611756

Renkai Ge commented on FLINK-4883:

How about to extend the method org.apache.flink.streaming.api.datastream.DataStream#clean
to make it not only clean the function but also check if the function is a scala object, I
think it's the way to implement the detection with minimal changes.

> Prevent UDFs implementations through Scala singleton objects
> ------------------------------------------------------------
>                 Key: FLINK-4883
>                 URL: https://issues.apache.org/jira/browse/FLINK-4883
>             Project: Flink
>          Issue Type: Bug
>            Reporter: Stefan Richter
>            Assignee: Renkai Ge
> Currently, user can create and use UDFs in Scala like this:
> {code}
> object FlatMapper extends RichCoFlatMapFunction[Long, String, (Long, String)] {
> ...
> }
> {code}
> However, this leads to problems as the UDF is now a singleton that Flink could use across
several operator instances, which leads to job failures. We should detect and prevent the
usage of singleton UDFs.

This message was sent by Atlassian JIRA

View raw message