spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-30794) Stage Level scheduling: Add ability to set off heap memory
Date Mon, 27 Jul 2020 13:19:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-30794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Thomas Graves resolved SPARK-30794.
-----------------------------------
    Fix Version/s: 3.1.0
       Resolution: Fixed

> Stage Level scheduling: Add ability to set off heap memory
> ----------------------------------------------------------
>
>                 Key: SPARK-30794
>                 URL: https://issues.apache.org/jira/browse/SPARK-30794
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.1.0
>            Reporter: Thomas Graves
>            Assignee: Zhongwei Zhu
>            Priority: Major
>             Fix For: 3.1.0
>
>
> For stage level scheduling in ExecutorResourceRequests we support setting heap memory,
pyspark memory, and memory overhead. We have no split out off heap memory as its own configuration
so we should add it as an option.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message