flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1296) Add support for very large record for sorting
Date Sun, 07 Dec 2014 23:12:12 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237311#comment-14237311
] 

ASF GitHub Bot commented on FLINK-1296:
---------------------------------------

Github user StephanEwen commented on the pull request:

    https://github.com/apache/incubator-flink/pull/249#issuecomment-65960391
  
    This failes with the java 6 compiler, because it has a generics bug. I'll try and work
around it...


> Add support for very large record for sorting
> ---------------------------------------------
>
>                 Key: FLINK-1296
>                 URL: https://issues.apache.org/jira/browse/FLINK-1296
>             Project: Flink
>          Issue Type: Bug
>          Components: Local Runtime
>    Affects Versions: 0.8-incubating
>            Reporter: Stephan Ewen
>            Assignee: Stephan Ewen
>             Fix For: 0.8-incubating
>
>
> Currently, very large records (multiple hundreds of megabytes) can break the sorter if
the overflow the sort buffer.
> Furthermore, if a merge is attempted of those records, pulling multiple of them concurrently
into memory can break the machine memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message