spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anirudh Ramanathan (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-22839) Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner abstraction
Date Fri, 13 Apr 2018 15:45:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-22839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Anirudh Ramanathan resolved SPARK-22839.
----------------------------------------
       Resolution: Fixed
    Fix Version/s: 3.0.0

Issue resolved by pull request 20910
[https://github.com/apache/spark/pull/20910]

> Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner
abstraction
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-22839
>                 URL: https://issues.apache.org/jira/browse/SPARK-22839
>             Project: Spark
>          Issue Type: Improvement
>          Components: Kubernetes
>    Affects Versions: 2.3.0
>            Reporter: Yinan Li
>            Assignee: Matt Cheah
>            Priority: Major
>             Fix For: 3.0.0
>
>
> As discussed in https://github.com/apache/spark/pull/19954, the current code for configuring
the driver pod vs the code for configuring the executor pods are not using the same abstraction.
Besides that, the current code leaves a lot to be desired in terms of the level and cleaness
of abstraction. For example, the current code is passing around many pieces of information
around different class hierarchies, which makes code review and maintenance challenging. We
need some thorough refactoring of the current code to achieve better, cleaner, and consistent
abstraction.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message