spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (Jira)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-30794) Stage Level scheduling: Add ability to set off heap memory
Date Thu, 02 Jul 2020 00:44:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-30794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17149759#comment-17149759
] 

Apache Spark commented on SPARK-30794:
--------------------------------------

User 'warrenzhu25' has created a pull request for this issue:
https://github.com/apache/spark/pull/28972

> Stage Level scheduling: Add ability to set off heap memory
> ----------------------------------------------------------
>
>                 Key: SPARK-30794
>                 URL: https://issues.apache.org/jira/browse/SPARK-30794
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.1.0
>            Reporter: Thomas Graves
>            Priority: Major
>
> For stage level scheduling in ExecutorResourceRequests we support setting heap memory,
pyspark memory, and memory overhead. We have no split out off heap memory as its own configuration
so we should add it as an option.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message