flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zhijiangW <...@git.apache.org>
Subject [GitHub] flink issue #3467: [FLINK-4545] preparations for removing the network buffer...
Date Tue, 14 Mar 2017 04:30:03 GMT
Github user zhijiangW commented on the issue:

    https://github.com/apache/flink/pull/3467
  
    @NicoK ´╝îthank you for explanation,  and I already trace the code in your local branch.
Wish your further change commit in global pool.
    
    @StephanEwen , thanks for further elaboration. From my understanding, each task can decide
the core number of buffers in `LocalBufferPool` based on input, output channels and configuration,
the maximum number of buffers based on `ResultPartitionType`. And all the `LocalBufferPool`s
make effect on the total number of buffers in `NetworkBufferPool`, may need consider maximum
memory usages.
    
    And my concern is to consider the memory usages in `NetworkBufferPool` before starts the
`TaskManager`, and this part of memory should be added into the total resource of `TaskManager`.

    I am willing to do that as a part of my current work in [Fine-grained Resource Configuration](https://issues.apache.org/jira/browse/FLINK-5131)
after this feature completes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message