flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4571) Configurable little parallelism in Gelly drivers
Date Thu, 08 Sep 2016 21:14:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15475029#comment-15475029

ASF GitHub Bot commented on FLINK-4571:

Github user asfgit closed the pull request at:


> Configurable little parallelism in Gelly drivers
> ------------------------------------------------
>                 Key: FLINK-4571
>                 URL: https://issues.apache.org/jira/browse/FLINK-4571
>             Project: Flink
>          Issue Type: Improvement
>          Components: Gelly
>    Affects Versions: 1.2.0
>            Reporter: Greg Hogan
>            Assignee: Greg Hogan
>            Priority: Minor
> Several Gelly library implementations support a configurable "little parallelism" which
is important when scaling to large data sets. These algorithms include operators at the beginning
and end which process data on the order of the original DataSet, as well as middle operators
that exchange 100s or 1000s more data. The "little parallelism" should be configurable in
the appropriate Gelly drivers in the flink-gelly-examples module.

This message was sent by Atlassian JIRA

View raw message