flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3888) Custom Aggregator with Convergence can't be registered directly with DeltaIteration
Date Mon, 17 Oct 2016 13:21:58 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582247#comment-15582247
] 

ASF GitHub Bot commented on FLINK-3888:
---------------------------------------

Github user vasia commented on the issue:

    https://github.com/apache/flink/pull/2606
  
    Thank you for the review @greghogan! I have addressed your comments.


> Custom Aggregator with Convergence can't be registered directly with DeltaIteration
> -----------------------------------------------------------------------------------
>
>                 Key: FLINK-3888
>                 URL: https://issues.apache.org/jira/browse/FLINK-3888
>             Project: Flink
>          Issue Type: Bug
>          Components: Iterations
>            Reporter: Martin Liesenberg
>            Assignee: Vasia Kalavri
>
> Contrary to the [documentation|https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/iterations.html]
the method to add an aggregator with a custom convergence criterion to a DeltaIteration is
not exposed directly to DeltaIteration, but can only be accessed via the {{aggregatorRegistry}}.
> Moreover, when registering an aggregator with a custom convergence criterion  and running
the program, the following exception appears in the logs:
> {noformat}
> Error: Cannot use custom convergence criterion with workset iteration. Workset iterations
have implicit convergence criterion where workset is empty.
> org.apache.flink.optimizer.CompilerException: Error: Cannot use custom convergence criterion
with workset iteration. Workset iterations have implicit convergence criterion where workset
is empty.
> 	at org.apache.flink.optimizer.plantranslate.JobGraphGenerator.finalizeWorksetIteration(JobGraphGenerator.java:1518)
> 	at org.apache.flink.optimizer.plantranslate.JobGraphGenerator.compileJobGraph(JobGraphGenerator.java:198)
> 	at org.apache.flink.optimizer.plantranslate.JobGraphGenerator.compileJobGraph(JobGraphGenerator.java:164)
> 	at org.apache.flink.test.util.TestEnvironment.execute(TestEnvironment.java:76)
> 	at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:898)
> 	at org.apache.flink.api.java.DataSet.collect(DataSet.java:410)
> 	at org.apache.flink.api.java.DataSet.print(DataSet.java:1605)
> {noformat}
> The issue has been found while discussing FLINK-2926



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message