flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4504) Support user to decide whether the result of an operator is presistent
Date Fri, 21 Oct 2016 08:13:58 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594436#comment-15594436
] 

ASF GitHub Bot commented on FLINK-4504:
---------------------------------------

GitHub user shuai-xu opened a pull request:

    https://github.com/apache/flink/pull/2675

    [FLINK-4504][dataset api]Support user to decide whether the result of an operator is presistent

    This pr is based on #2674 , it add an setOptions() interface to the class Operator, so
user can calltext.flatMap().setOptions(ConfigConstants.OPERATOR_RESULT_PERSISTENT_TYPE , "DFS")
to specify that the result of flaMap() should be put to DFS.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/alibaba/flink jira-4504

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/2675.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2675
    
----
commit b0c4ed17c441e0bb7985afeea9288d601ea89897
Author: shuai.xus <shuai.xus@alibaba-inc.com>
Date:   2016-10-20T08:34:45Z

    [FLINK-4504][dataset api]Support user to decide whether the result of an operator is presistent

commit 7deeba0698923eb6af2f40e2cd9f0791cb288759
Author: shuai.xus <shuai.xus@alibaba-inc.com>
Date:   2016-10-21T08:04:26Z

    [FLINK-4504][dataset api] fix unittest fail

----


> Support user to decide whether the result of an operator is presistent
> ----------------------------------------------------------------------
>
>                 Key: FLINK-4504
>                 URL: https://issues.apache.org/jira/browse/FLINK-4504
>             Project: Flink
>          Issue Type: Sub-task
>          Components: DataSet API
>            Reporter: shuai.xu
>            Assignee: shuai.xu
>
> Support an api to user for deciding whether they need the result of an operator to be
pipeline, spilled to local file or persisted to distribute file system.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message