spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Gummelt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-17454) Add option to specify Mesos resource offer constraints
Date Fri, 23 Sep 2016 17:15:20 GMT

    [ https://issues.apache.org/jira/browse/SPARK-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15517007#comment-15517007
] 

Michael Gummelt commented on SPARK-17454:
-----------------------------------------

So you're trying to only launch executors on nodes with a sufficient amount of disk space?

> Add option to specify Mesos resource offer constraints
> ------------------------------------------------------
>
>                 Key: SPARK-17454
>                 URL: https://issues.apache.org/jira/browse/SPARK-17454
>             Project: Spark
>          Issue Type: Improvement
>          Components: Mesos
>    Affects Versions: 2.0.0
>            Reporter: Chris Bannister
>
> Currently the driver will accept offers from Mesos which have enough ram for the executor
and until its max cores is reached. There is no way to control the required CPU's or disk
for each executor, it would be very useful to be able to apply something similar to spark.mesos.constraints
to resource offers instead of attributes on the offer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message