spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ilan Filonenko (Jira)" <j...@apache.org>
Subject [jira] [Created] (SPARK-30160) Extend ExecutorPodAllocator for arbitrary CRDs
Date Sat, 07 Dec 2019 00:31:00 GMT
Ilan Filonenko created SPARK-30160:
--------------------------------------

             Summary: Extend ExecutorPodAllocator for arbitrary CRDs
                 Key: SPARK-30160
                 URL: https://issues.apache.org/jira/browse/SPARK-30160
             Project: Spark
          Issue Type: New Feature
          Components: Kubernetes
    Affects Versions: 2.4.4, 3.0.0
            Reporter: Ilan Filonenko


There are internal use-cases at companies that require for executor creation to be done by
privileged resources (like admin controllers / operators who would receive events or updates)
that would create the Kubernetes Executor pods on-behalf of the user. In essence, the assumption
that the driver has the appropriate service-account to create pods is not a guarantee in various
organizations.

This proposed JIRA looks to create a pluggable interface for pod creation and deletion to
allow for customizable allocation libraries to exist i.e. CRDs that scale up and down



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message