flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2834) Global round-robin for temporary directories
Date Fri, 09 Oct 2015 08:58:26 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950096#comment-14950096
] 

Maximilian Michels commented on FLINK-2834:
-------------------------------------------

+1

> Global round-robin for temporary directories
> --------------------------------------------
>
>                 Key: FLINK-2834
>                 URL: https://issues.apache.org/jira/browse/FLINK-2834
>             Project: Flink
>          Issue Type: Improvement
>          Components: Distributed Runtime
>    Affects Versions: 0.10
>            Reporter: Greg Hogan
>            Assignee: Greg Hogan
>            Priority: Minor
>
> Currently each {{FileIOChannel}} performs a local round-robin among temporary directories.
Initially every writer will be concurrently spilling to the same first directory, then the
same second directory, etc. Even when evenly dispersed this effect will naturally occur due
to the bunching effect.
> One solution is to use a global counter when selecting the temporary path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message