[ https://issues.apache.org/jira/browse/SPARK-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286466#comment-14286466
]
Asim Jalis commented on SPARK-4506:
-----------------------------------
This bug should be reopened. The doc needs some more changes.
Doc: https://github.com/apache/spark/blob/master/docs/submitting-applications.md
Current text: Note that cluster mode is currently not supported for standalone clusters, Mesos
clusters, or Python applications.
Proposed text: Note that cluster mode is currently not supported for Mesos clusters, or Python
applications.
> Update documentation to clarify whether standalone-cluster mode is now officially supported
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-4506
> URL: https://issues.apache.org/jira/browse/SPARK-4506
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 1.1.0, 1.1.1, 1.2.0
> Reporter: Josh Rosen
> Assignee: Andrew Or
> Fix For: 1.1.1, 1.2.0
>
>
> The "Launching Compiled Spark Applications" section of the Spark Standalone docs claims
that standalone mode only supports {{client}} deploy mode:
> {quote}
> The spark-submit script provides the most straightforward way to submit a compiled Spark
application to the cluster. For standalone clusters, Spark currently only supports deploying
the driver inside the client process that is submitting the application (client deploy mode).
> {quote}
> It looks like {{standalone-cluster}} mode actually works (I've used it and have heard
from users that are successfully using it, too).
> The current line was added in SPARK-2259 when {{standalone-cluster}} mode wasn't officially
supported. It looks like SPARK-2260 fixed a number of bugs in {{standalone-cluster}} mode,
so we should update the documentation if we're now ready to officially support it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org
|