spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ilan Filonenko (Jira)" <>
Subject [jira] [Created] (SPARK-30160) Extend ExecutorPodAllocator for arbitrary CRDs
Date Sat, 07 Dec 2019 00:31:00 GMT
Ilan Filonenko created SPARK-30160:

             Summary: Extend ExecutorPodAllocator for arbitrary CRDs
                 Key: SPARK-30160
             Project: Spark
          Issue Type: New Feature
          Components: Kubernetes
    Affects Versions: 2.4.4, 3.0.0
            Reporter: Ilan Filonenko

There are internal use-cases at companies that require for executor creation to be done by
privileged resources (like admin controllers / operators who would receive events or updates)
that would create the Kubernetes Executor pods on-behalf of the user. In essence, the assumption
that the driver has the appropriate service-account to create pods is not a guarantee in various

This proposed JIRA looks to create a pluggable interface for pod creation and deletion to
allow for customizable allocation libraries to exist i.e. CRDs that scale up and down

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message