spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-26674) Consolidate CompositeByteBuf when reading large frame
Date Tue, 26 Feb 2019 00:42:01 GMT

     [ https://issues.apache.org/jira/browse/SPARK-26674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marcelo Vanzin resolved SPARK-26674.
------------------------------------
       Resolution: Fixed
    Fix Version/s: 3.0.0

Issue resolved by pull request 23602
[https://github.com/apache/spark/pull/23602]

> Consolidate CompositeByteBuf when reading large frame
> -----------------------------------------------------
>
>                 Key: SPARK-26674
>                 URL: https://issues.apache.org/jira/browse/SPARK-26674
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.4.0
>            Reporter: liupengcheng
>            Assignee: liupengcheng
>            Priority: Major
>             Fix For: 3.0.0
>
>
> Currently, TransportFrameDecoder will not consolidate the buffers read from network which
may cause memory waste. Actually, bytebuf's writtenIndex is far less than it's capacity 
in most cases, so we can optimize it by doing consolidation.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message