spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Trevor McKay (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-24534) Add a way to bypass entrypoint.sh script if no spark cmd is passed
Date Thu, 14 Jun 2018 20:32:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-24534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512949#comment-16512949
] 

Trevor McKay commented on SPARK-24534:
--------------------------------------

This is useful in situations like this for the spark-on-k8s-operator, where there is a need
to execute the userid preamble but fall through to another command. I think that would be
preferable to copy-pasting the boilerplate across the imagesphere :)

https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/pull/189

> Add a way to bypass entrypoint.sh script if no spark cmd is passed
> ------------------------------------------------------------------
>
>                 Key: SPARK-24534
>                 URL: https://issues.apache.org/jira/browse/SPARK-24534
>             Project: Spark
>          Issue Type: Improvement
>          Components: Kubernetes
>    Affects Versions: 2.3.0
>            Reporter: Ricardo Martinelli de Oliveira
>            Priority: Minor
>
> As an improvement in the entrypoint.sh script, I'd like to propose spark entrypoint do
a passthrough if driver/executor/init is not the command passed. Currently it raises an error.
> To me more specific, I'm talking about these lines:
> [https://github.com/apache/spark/blob/master/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh#L113-L114]
> This allows the openshift-spark image to continue to function as a Spark Standalone component,
with custom configuration support etc. without compromising the previous method to configure
the cluster inside a kubernetes environment.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message