flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vinoyang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-11818) Provide pipe transformation function for DataSet API
Date Tue, 05 Mar 2019 06:42:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784151#comment-16784151

vinoyang commented on FLINK-11818:

[~fhueske] and [~till.rohrmann] what do you think about this issue? 

> Provide pipe transformation function for DataSet API
> ----------------------------------------------------
>                 Key: FLINK-11818
>                 URL: https://issues.apache.org/jira/browse/FLINK-11818
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / DataSet
>            Reporter: vinoyang
>            Assignee: vinoyang
>            Priority: Major
> We have some business requirements that require the data handled by Flink to interact
with some external programs (such as Python/Perl/shell scripts). There is no such function
in the existing DataSet API, although it can be implemented by the map function, but it is
not concise. It would be helpful if we could provide a pipe[1] function like Spark.
> [1]: https://spark.apache.org/docs/latest/rdd-programming-guide.html#transformations

This message was sent by Atlassian JIRA

View raw message